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ABSTRACT 


This  work  begins  with  a  study  of  individual  decision-making 
under  uncertainty,  a  problem  which  we  formulate  as 

(1)  Maximize  f(x,£)  subject  to  g^XjP)  >0,  i  *  1,  ...  ,  m  , 

where  x  is  a  decision  n-vector,  £  is  a  b- vector  of  exogenous 
variables  and  parameters  of  the  decision  model,  f  is  an  objective 
function  to  be  maximized,  and  the  are  constraint  functions 
which  determine  the  set  of  feasible  decisions.  The  source  of  uncer¬ 
tainty  is  0,  which  is  known  only  to  lie  in  a  given  set  B.  We 
also  consider  the  case  in  which  a  probability  distribution  over  B 
is  given. 

Several  methods  for  circumventing  uncertainty  in  the  constraints 
are  briefly  reviewed,  and  several  decision  criteria  for  circumventing 
uncertainty  in  the  objective  function  are  discussed.  Particular 
attention  is  devoted  to  the  demonstration  of  certain  relationships 
between  these  criteria  It  is  concluded  that  vector  maximum  reformu¬ 
lations  of  (l)  play  a  prominent  role  in  dealing  with  uncertainty  in 
such  decision  problems. 

A  vector  maximum  problem  is  of  the  form 

"Maximize"  f^(x),  ...  ,  f^Qc) 

(2)  - 

subject  to  g^(x)  >  0,  i  *  1,  . . .  ,  m  . 

Th<?  quotation  marks  signify  that  it  is  desired  to  find  all  efficient 
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decisions,  i.e.,  all  decision  vectors  satisfying  the  constraints 


such  that  it  is  impossible  to  achieve  an  increase  in  any  one  objective 
function  without  violating  the  constraints  or  decreasing  at  least 
one  of  the  other  objective  functions.  In  Chapter  II  we  discuss  two 
methods  for  transforming  a  vector  maximum  problem  into  an  equivalent 
parametric  programming  problem.  Existing  computational  methods  for 
the  latter  problems  are  briefly  surveyed. 

The  principal  contribution  of  this  work  is  presented  in  Chapter  III: 
a  class  of  algorithms  for  solving  parametric  concave  programming 
problems  of  the  form 

Maximize  af^(x)  +  (l-a)f2(x) 

(3)  * 

subject  to  g^x)  >0,  i  =  1,  ...  ,  m 

for  each  fixed  value  of  a  in  the  closed  interval  [0,1],  where 
f^  (i  =  1,2)  are  strictly  concave  functions,  g^  (i  =  l,...,m) 
are  concave  functions,  and  certain  additional  regularity  assumptions 
are  made.  Under  these  assumptions  it  is  shown  that  (2)  (with  r  =  2) 
and  (} )  are  equivalent  in  the  sense  that  x°  is  efficient  in  (2) 
if  and  only  if  x°  solves  (3)  for  some  value  of  a:  in  the  unit 
interval.  The  present  class  of  algorithms  is  not  "simplex-like" 
or  "gradient"  in  nature,  but  proceeds  by  maintaining  a  solution  of 
the  Kuhn- Tucker  Conditions  as  a  varies  by  small  increments  (under 
our  assumptions  these  conditions  are  necessary  and  sufficient  for 
an  optimal  solution  of  (3))*  The  main  algorithm  given  herein  displays 
quadratic  convergence  at  each  increment  of  a.  A  simple  modification 
for  handling  linear  equality  constraints  is  indicated. 


Problem  (3)  also  subsumes  the  standard  (non- parametric)  concave 
programming  problem  when  a  feasible  solution  is  known.  Thus  the 
present  algorithms  provide  a  deformation  method  of  concave  programming. 
Since  many  of  the  results  of  this  chapter  hold  for  much  more  general 
parametric  problems  than  (3),  moreover,  the  present  algorithms  are 
pertinent  to  sensitivity  analysis  applications. 

The  final  chapter  presents  a  numerical  example  which  illustrates 
the  solution  of  a  decision  problem  under  uncertainty  by  means  of  the 
techniques  discussed  in  the  preceding  chapters. 
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Notation 

x  s  (x, .  ,x  )  is  a  decision  vector  in  En  (n-dimensional  Euclidean 
space),  and  is  under  the  control  of  the  decision-maker 

P  s  (p^,...,^)  is  an  uncertain  vector  in  E*5  representing  exogenous 
variables  and  model  parameters,  and  is  not  under  the  control 
of  the  decision-maker 

f(x,£)  is  a  real-valued  criterion  function  which  is  to  be  maximized; 

if  there  is  no  dependence  on  p,  ve  write  f (x) ;  if  there 
are  several  criterion  functions,  we  write  f(x)  for 
(f^x),. . .  ,fr(x)) 

g(x,P)  s  (g^x, g^x,?))  is  a  real  vector-valued  constraint 
function;  if  there  is  no  dependence  on  p,  we  write  £(x) 

[z  e  Z:  z  has  property  P}  denotes  the  set  of  all  elements  z 

in  the  set  Z  which  have  property  P;  when  Z  is  omitted, 
it  is  implicitly  understood  to  be  the  pertinent  universal 
set 

X  is  a  subset  of  En  consisting  of  the  feasible  decisions;  often 
X  represents  {x:  g(x)  >  0} 

B  (in  Chapter  I)  is  a  subset  of  E^  which  is  known  to  contain  the 
"true  realization"  of  p 

x  >  (>)  0  signifies  x^  >  (>)  0  (i  =  l,...,n) 

xi 


x  >  0  signifies  x  >  0  but  x  4  0 


H  denotes  a  probability  distribution  over  B 


C  C(O)  D  signifies  that  the  set  C  is  a  (proper)  subset  of  D 


Vi0)  *  [i;  [jS  (vxi)2] '  <rj 


<  r \  ,  an  open  neighborhood  of  x 

A  J 

of  radius  r 

F(a)  denotes  the  maximum  a-fractile  cr.  terion  (see  problem  (4.5) 
of  Chapter  I) 

A(M)  denotes  the  aspiration  criterion  with  aspiration  level  M 
(see  problem  (4.6)  of  Chapter  I) 

[a,b)  =  {t  e  E1:  a  <  t  <  b) 

(Kx)  denotes  the  parametric  programming  problem  considered  in 

Chapter  III;  the  parameter  a  may  vary  in  this  notation 
(there  is  no  relation  between  this  usage  of  a  and  that 
of  Chapter  I) 


f(x;a)  =  afx(x)  +  (l-a)f2(x) 


W  ■ 


^f(x) 


\  ,  the  gradient  of  f(x) 

bx. 


n 


S  denotes  a  subset  of  constraint  indices;  S  C  M,  where  M  is 
the  set  of  the  first  m  positive  integers 


u  =  (u, ,...,u  )  denotes  the  dual  variables  associated  with  the 
-  v  1  m 

Kuhn- Tucker  conditions 


xii 


(KT-l) , . . . , (KT-4)  are,  collectively,  one  version  of  the  Kuhn- 
Tucker  conditions  associated  with  (Fa) 

(=S)a  is  a  more  complete  notation  for  the  equations  (KT-l)  and 
(KT-2) ;  S  and  a  may  vary  in  this  notation 

(x*(a) ,  u*(a))  is  the  optimal  solution  and  dual  variables  of  (Fa) 
as  functions  of  a 

s  s 

(x  (a) ,  u  (a))  is  a  solution  of  (=S)a  as  a  function  of  a 

y^f(x)  denotes  the  matrix  of  second  partial  derivatives  (i.e.,  the 
hessian)  of  f(x) 

<  xV  > -*  x°  means  that  the  (infinite)  sequence  x\x^, . . .  ,xV, . . . 

o 

converges  to  x 

C-D  denotes  the  points  in  the  set  C  which  are  not  in  the  set  D 

Pa  =  {i  e  M:  uf(a)  >  0),  the  set  of  active  constraints  at  a;  a 
may  vary  in  this  notation 

Ba  =  {i  €  M:  g^(x*(a))  =  0],  the  set  of  binding  constraints  at 
x*(a) ;  a  may  vary  in  this  notation 

0£  ’  ( j  =  1,...,N)  are  the  points  of  change  of  Pa  or  of  Ba  in  the 
J 

unit  interval  j  a'  is  a  generic  term  for  a  point  of  change 
a'+  is  an  arbitrary  point  strictly  between  two  points  of  change 
Ta'  ^  (a '•£,  a '+£],  where  l  is  defined  immediately  above  Theorem  4.2, 


Chapter  III 


CHAPTER  I 


On  the  Relevance  of  the  Vector  Maximum 
Problem  to  Decision-Making  Under  Uncertainty 

1.  Introduction 

This  chapter  addresses  a  problem  of  individual  decision-making 
under  uncertainty  of  the  form 

(l)  Maximize  f(x,£)  subject  to  ^(x,p)  ^0  , 

x 

where  x  =  (x^,...,xn)  is  the  decision  vector,  0  -  (0^,...,B  )  is 
a  vector  of  exogenous  variables  and  parameters  of  the  model,  f  is 
the  objective  (or  criterion  or  payoff)  function  to  be  maximized, 
and  g  =  is  a  vector- valued  constraint  function  which 

determines  the  set  of  feasible  decisions.  We  assume  that  the  functions 
f  and  g  are  known,  but  that  0  is  known  only  to  lie  in  a  given 
set  B  C.  E*5,  where  Eb  is  b-dimensional  Euclidean  space.  Often 
we  shall  make  the  additional  assumption  that  0  may  be  regarded  as 
a  random  variable  with  a  known  probability  distribution  over  B. 

A  choice  of  x  must  be  made  before  0  is  found  out,  if,  indeed, 
it  ever  is  revealed  to  the  decision-maker.  Throughout  this  chapter, 
no  experimentation  is  permitted  in  order  to  reduce  uncertainty  about 

If  0  were  known  exactly,  then  (l)  would  be  a  well-defined 
problem  (providing  that  the  desired  maximum  exists,  of  course). 

But  we  have  assumed  that  0  is  uncertain,  and  so  (l)  is  not  well-defined. 
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There  are  two  distinct  aspects  of  the  difficulties  arising  from 
uncertainty  in  3:  the  set  of  feasible  decisions  is  uncertain,  and 
the  objective  function  is  uncertain.  Maximization  cannot  .be  performed 
until  the  constraints  and  objective  function  are  reformulated  so  as 
to  be  independent  of  3*  We  shall  discuss  a  variety  of  such  reformu¬ 
lations,  and  it  will  be  seen  that  quite  frequently  vector  maximum 
reformulations  play  a  prominent  role. 


The  Vector  Maximum  Problem 

A  vector  maximum  problem  arises  whenever  there  is  more  than  one 
objective  function  to  be  extremized.  Consider  the  problem 


(2) 


"Maximize"  f(x)  , 
X  €  X 


where  f  (x)  j*  ( f  1(x) , . . . ,  fr  (x) )  is  a  vector-valued  objective  function 
(each  component  of  f  represents  an  objective,  usually  non-additive 
with  the  others,  which  the  decision-maker  wants  to  maximize),  and 
X  CZ  En  is  a  set  of  feasible  decisions.  In  the  fortunate  event  that 
each  component  of  the  objective  function  reaches  its  maximum  simul¬ 
taneously,  as  in  Figure  1,  then  (2)  is  said  to  have  a  perfect  solution. 
In  general,  however,  an  improvement  of  one  objective  beyond  a  certain 
point  can  only  be  obtained  at  the  expense  of  worsening  another. 

Suppose  that  for  a  feasible  decision  x°  there  exists  no  other  feasible 
decision  x1  such  that^  ffa1)  >  f(x°).  Then  x°  is  termed  an 


In  this  work  we  adopt  the  convention  that  x  >  0  signifies 


xi  -  0  (i  *  1, . . .  ,n) ,  x  >  0  signifies  x^^  >  0  (i  =  1, . . .  ,n)  and 
xi  >  0  for  at  least  one  i,  and  x  >  0  signifies  x^  >  0  (i  *  1, 
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efficient  solution^  of  (2).  The  quotation  marks  in  (2)  signify 
that  it  is  desired  to  find  ail  efficient  solutions.  When  they  are 
all  found,  the  vector  maximum  problem  (2)  has  been  solved. 

When  f  has  only  two  or  three  components,  we  envision  determining 
the  entire  set  of  efficient  solutions  and  presenting  the  corresponding 
outcomes  in  graphical  form  to  the  decision-maker,  who  would  then 
subjectively  determine  a  trade-off  between  conflicting  objectives 
and  thus  make  the  final  selection  of  a  decision.  Figures  1  and  2 
illustrate  the  graph  of  attainable  outcomes  for  two  hypothetical  cases 
involving  two  objective  functions.  The  efficient  outcomes  are  denoted 
by  the  heavy  line  and  dot. 


In  many  applied  decision  problems,  even  in  the  absence  of  uncer¬ 
tainty,  there  are  several  objective  functions  which  naturally  present 
themselves  to  the  decision-maker.  In  such  situations,  the  relevance 


-  The  notion  of  an  efficient  solution  is  essentially  the  same  as 
the  notion  of  "undominated"  or  "admissible"  decisions  in  decision 
theory,  and  the  notion  of  "Pareto  optimality"  in  game  theory  (see 
Luce  and  Raiffa,  1957>  p.  287  and  p.  118). 
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of  the  vector  maximum  problem  is  obvious,  and  need  not  be  emphasized 
further.  What  we  do  wish  to  emphasize  is  that  in  the  presence  of 
uncertainty  even  a  single-criterion- function  problem  such  as  (l), 
which  we  would  accept  as  the  "correct"  formulation  if  B  were  known 
exactly,  tends  to  explode  into  vector  maximum  reformulations  when 
one  attempts  to  turn  it  into  a  well-defined  problem. 

Plan  of  Discussion 

Because  uncertainty  in  the  constraints  is  fundamentally  different 
from  uncertainty  in  the  objective  function  of  (l),  we  split  our  dis¬ 
cussion  into  two  parts:  in  section  2  we  consider  ways  of  reformulating 
the  constraints  so  as  to  be  independent  of  B,  and  in  section  3  we 
consider  ways  of  reformulating  the  objective  function  so  as  to  be 
independent  of  B  (this  is  usually  known  as  invoking  a  decision 
criterion).  These  two  steps  must  be  accomplished  in  order  to  convert 
(l)  into  a  well-defined  problem.  The  conversion  usually  can  be 
accomplished  in  several  ways,  reflecting  various  compromises  which 
may  be  made  to  uncertainty  in  (3,  realism  in  the  final  model,  and 
computational  considerations. 

In  section  2,  three  reformulations  of  the  constraints  will  be 
discussed:  permanent  feasibility,  the  penalty  function  reformulation, 
and  probabilistic  constraints.  The  first  two  do  not  require  a  proba¬ 
bility  distribution  over  B,  while  the  last  does.  The  last  two 
reformulations  sometimes  lead  to  a  vector  maximum  problem. 

In  section  3  we  consider  several  decision  criteria,  and  some 
relations  between  them  are  noted.  We  suggest  that  a  given  decision 


problem  should  be  attacked  by  several  decision  criteria  rather  than 
by  only  one.  The  result  is,  of  course,  a  vector  maximum  problem.  Two 
examples  are  presented  which  demonstrate  the  usefulness  of  considering 
two  criteria  simultaneously.  The  second  example  is  a  one-period 
inventory  model,  and  an  argument  is  given  for  deviating  from  the 
now  classical  solution. 

2.  Treating  Uncertainty  in  the  Feasibility  Constraints 

This  section  is  essentially  a  review  of  some  of  the  existing 
ways  of  circumventing  uncertainty  in  the  constraints,  and  is  included 
mainly  for  completeness.  Mixtures  and  variations  of  these  basic 
approaches  can  be  improvised  to  cover  most  particular  applications. 

The  Permanent  Feasibility  Reformulation 

To  be  absolutely  sure  of  choosing  a  feasible  decision,  choice 

must  be  limited  to  those  values  of  x  which  are  feasible  for  all 

P  e  B.  That  is,  restrict  attention  to  the  set^^  n  Cx:  g(x,p)  >  0} 

P  e  B  "  -  -  =  - 

(see  Madansky,  1962  and  1963)  • 

An  obvious  difficulty  with  this  reformulation  is  that  when  B 
is  "large,"  the  permanently  feasible  set  is  apt  to  be  "small,"  i-.i  even 
may  be  empty.  When  the  maximization  operation  is  performed  :  '  je^uently, 
there  may  be  little  opportunity  to  achieve  a  satisfactorily  high  value 
of  the  objective  function. 

37 

—  We  adopt  the  notation  of  using  braces  to  denote  sets  in  this  work. 

The  symbol  0  denotes  the  empty  set. 


The  Penalty  Function  Reformulation 


The  above  reformulation  does  not  admit  the  possibility  of  ever 
choosing  a  decision  which  is  infeasible.  What  does  it  mean  to  say  that 
a  decision  x'  is  "infeasible"  when,  say,  obtains?  Mathematically, 

we  have  g(x',|3')  jt  which  means  that  either  (x',P')  is  physically 
impossible,  or  is  physically  possible  but  "undesirable"  (we  are  dis¬ 
tinguishing  between  those  constraints  which  are  dictated  by  the  physical 
limitations  of  the  system  and  those  which  are  imposed  at  the  model- 
maker's  discretion).  In  the  second  case,  it  may  be  possible  to  take 
additional  action  in  order  to  make  the  outcome  less  "undesirable," 
or  at  least  to  pay  a  price  for  being  "infeasible."  Denote  this  "price" 
by  £(x',P'),  not  necessarily  measured  in  dollars.  Note  that  jj)  is, 
in  general,  a  vector- valued  function,  reflecting  the  fact  that  vio¬ 
lations  of  different  constraints  may  imply  different  dimensions  of 
disutility.  For  example,  consider  an  investment  portfolio  optimization 
model  which  has  as  its  objective  the  maximization  of  portfolio  worth 
at  the  end  of  a  specified  horizon.  One  constraint  may  specify  a  desired 
level  of  diversification  (e.g.,  a  maximum  of  30$  of  the  portfolio  in 
defense  industries) ,  and  another  constraint  may  specify  a  lower  bound 
on  the  average  Standard  and  Poor's  quality  rating  of  the  securities. 
Violation  of  each  of  these  constraints  would  be  measured  in  different 
units  from  the  unit  of  measurement  of  the  objective  function. 

The  penalty  function  reformulation  of  (l)  results,  in  general, 
in  a  vector  maximum  problem  of  the  form 

(3)  "Maximize"  f (x,J3) ,  -£(*>£)  • 

x 
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An  important  special  case  arises  when  p  has  but  one  component, 
and  this  component  is  additive  with  f.  This  reformulation  then 
become ^ 

(3.1)  Maximize  [  f (x,£)  -  p(x,£)  ]  . 

x 

All  of  the  two-stage  "stochastic  programming"  problems  (see,  e.g., 
Dantzig,  1955 >  Madansky,  19^2,  and  Mangasarian  and  Rosen,  I96U)  can 
be  thought  of  as  penalty  function  reformulations.  The  basic  idea  of 
these  problems  is  to  a)  pend  a  second  stage  to  the  original  problem 
to  "correct  for"  possible  infeasibility  of  the  original  decision;  p 
then  represents  the  minimum  cost  of  correcting  for  an  infeasible  x, 
as  affected  by  the  then  known  actual  value  of  0.  The  usual  example 
of  a  situation  in  which  the  two-period  formulation  may  be  appropriate 
is  the  case  of  a  manufacturer  who  is  committed  to  produce  to  satisfy 
an  unknown  demand  £  for  his  perishable  products.  If  all  of  the 
demand  is  not  satisfied,  then  he  purchases  the  difference  on  the  open 
market . 


Probabilistic  Constraints 


Assume  that  £  may  be  regarded  as  a  random  variable,  and  that 
its  probability  distribution  over  B  is  known. 


— ' Note  that  (l)  can  be  written  equivalently  in  this  form  if  p  is 
taken  to  be  arbitrarily  large  for  infeasible  combinations  of  x  and 
0,  and  equal  to  zero  for  feasible  combinations.  For  example,” 


[  Inf  [f(x)  +  £  u  g  (x,0)  ]]  . 
u  >  0  ”  T  1  1  ” 


Maximize 

x 


The  notion  of  permanent  feasibility  may  be  relaxed  if  one  requires 
merely  that  each  or  all  of  the  constraints  must  hold  with  at  least 
some  prescribed  probability.  For  example,  consider 

Maximize  f(x,0) 
x 

subject  to  Prob[gi(x,P)  >  0]  >  ai  ,  i  =  1,  ...  ,  m  , 

where  0  <  a^  <  1  (i  =  l,...,m).  Charnes  and  Cooper  (1959;  19^5) 
refer  to  this  as  "chance-constrained”  programming.  Note  that  when 
each  a^  is  nearly  one,  this  reformulation  approaches  the  permanent 
feasibility  reformulation. 

Another  probabilistic  constraint  reformulation  is 

Maximize  f(x,£) 
x 

subject  to  E[|5(x,f3)  ]  >  0  , 
where  "E"  denotes  expectation. 

As  an  alternative  to  the  formulations  above,  one  may  incorporate 
some  or  all  of  the  probabilistic  constraints  in  the  objective  function, 
e.  g. , 

"Maximize"  f(x,J3)  ,  Prob[  g^x,^)  >  0] 
x 

subject  to  Prob[gi(x,p)  >  0]  >  a^  ,  i  a  2,  J,  ...  ,  n 

The  efficient  solutions  to  the  resulting  vector  maximum  problem  show 
clearly  the  available  trade-offs  between  the  original  objective  function 
and  assurance  that  various  of  the  constraints  will  be  met. 
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Treating  Uncertainty  in  the  Objective  Function 
In  section  2  we  discussed  several  ways  oi  reformulating  the 
constraints  so  as  to  be  independent  of  0.  Here  we  assume  that  this 
has  been  accomplished,  and  discuss  several  ways  of  reformulating  the 
objective  functions  so  as  to  be  independent  of  (3.  For  the  sake  of 
simplicity  of  discussion,  we  shall  treat  the  case  of  but  a  single 
objective  function,  so  that  the  problem  to  be  considered  in  this  section 
can  be  rewritten  as 

oo  Maximize  f(x,0)  . 

x  e  X 

As  before,  0  is  known  to  lie  in  a  given  set  B,  and  X  is  the 
set  of  feasible  decisions. 

Since  it  is  necessary  to  choose  a  decision  x  before  3  is 
revealed  (if  it  is  ever  revealed),  f(x,0)  must  be  replaced  by  a 
known  function  of  x  alone.  That  is,  (4)  must  be  reformulated  as 

(4.0)  Maximize  f(x) 

X  €  X 

(V 

where  f  is  a  known  function  to  be  chosen.  The  choice  of  f  in  a 
given  situation  is  equivalent  to  what  is  customarily  known  as  the  choice 
of  a  decision  criterion.  If  a  decision  is  an  optimal  solution  of 
(4.0),  it  is  said  to  satisfy  the  decision  criterion  which  produces  f(x) 
from  f (x,0) . 

After  first  discussing  two  alternative  restatements  of  (4),  we 
shall  briefly  summarize  the  admissibility  criterion,  the  maxmin  payoff 
criterion,  the  estimate  criterion,  and  the  Principle  of  Insufficient 
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Reason.  The  difficulty  of  finding  a  single  ideal  decision  criterion 
is  well-known,  and  so  we  take  the  position  that  it  may  be  more  useful 
to  select  twc  ci iteria,  each  with  distinct  merits  of  its  own,  and 
recast  (4)  as  a  vector  maximum  problem  (each  component  of  the  vector¬ 
valued  objective  function  is  derived  from  one  decision  criterion). 

An  example  is  presented  to  illustrate  the  possible  advantages  of  such 
a  procedure. 

We  then  shall  assume  that  a  probability  distribution  over  B  is 
given.  The  concept  of  stochastic  admissibility  is  introduced  as  a 
generalization  of  the  ordinary  concept  of  admissibility.  Next  we 
examine  three  decision  criteria  for  reducing  (4)  to  a  well-defined 
problem  with  heavy  emphasis  on  a  geometric  motivation  for  each  in 
order  to  gain  insight  and  understanding.  These  cure  the  maximum 
expected  payoff  criterion,  the  maximum  a-fractile  criterion  (maximize 
the  a-fractile  of  the  distribution  of  f(x,P)  under  the  probability 
distribution  of  0,  for  sane  preselected  a),  and  an  aspiration 
criterion  (maximize  the  probability  of  achieving  at  least  some  pre¬ 
scribed  level  of  payoff).  Several  propositions  are  proved  which 
relate  these  criteria  to  each  other  and  to  the  previously  mentioned 
criteria  which  do  not  involve  probabilities.  Finally,  a  one-period 
inventory  example  is  presented  to  illustrate  the  ideas  of  this  section 
and  to  support  the  suggestion  that  several  criteria,  rather  than  a 
c ingle  one,  should  be  selected  to  embody  the  conflicting  aims  of  the 
decision-maker.  The  resulting  vector  maximum  problem  should  then  be 
solved  in  place  of  (4). 
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Alternative  Problem  Statements 


In  some  situations  the  objective  function  of  (4)  can  bo  written 
as  f(x,3)  =  F1(x)  +  F2(x,P).  If  F1  and  F2  each  represent  a 
quantity  which  the  decision-maker  wants  to  maximize,  one  may  reformu¬ 
late  (4)  as  a  two-component  vector  maximum  problem 

"Maximize"  F^x),  F2(x,3)  , 

x  e  X 

so  as  to  quarantine  the  part  depending  on  3.  The  advantage  of  this 

formulation  is  that  the  decision-maker  gains  a  clearer  understanding 

of  how  his  objectives  are  influenced  by  uncertainty.  As  an  example, 

let  F^  represent  the  immediate  payoff  of  a  multistage  decision 

problem,  and  let  F2  represent  the  present  worth  of  the  future  payoffs, 

where  3  represents  the  future  values  of  exogenous  variables. 

Another  restatement  of  (4)  is  obtained  by  using  regret  in  place 

of  payoff.  Assume  that  [  Max  f(x,P) ]  is  achieved  for  each  p  e  B. 

X  €  X 

The  regret  due  to  making  decision  x  and  then  observing  3  is  defined 
to  be 

r(x,P)  =  [  Max  f(x,3)  ]  -  f(x,3)  . 
x  e  X 

Stating  problems  in  terms  of  regret  rather  than  payoff  has  the  advantage 
of  highlighting  the  consequences  of  uncertainty  in  3  dramatically. 

In  addition,  gret  may  have  more  tractable  mathematical  properties 
than  payoff  (assuming  that  the  indicated  maximization  operation  is 
not  overly  difficult),  due  to  non-negativity  and  sometimes  symmetry. 
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When  3  is  known  exactly,  maximizing  payoff  is,  of  course, 

•  •xactly  equivalent  to  minimizing  regret.  When  3  is  uncer(,ain, 
however,  and  various  criteria  are  applied  in  order  to  arrive  at  a 
incision,  it  is  well-known  that  different  decisions  often  result 
depending  on  whether  payoff  or  regret  is  used. 

In  this  work  the  discussion  will  be  carried  on  primarily  in 
terms  of  payoff,  but  with  the  obvious  modifications  each  criterion 
can  be  applied  to  regret  as  well. 

3. 1  Reformulations  not  Involving  Probabilities 

We  shall  briefly  review  a  few  classical  decision  criteria  which 
do  not  involve  probabilities.  An  example  is  given  to  illustrate  that 
it  can  be  more  useful  to  consider  several  criteria  simultaneously 
rather  than  to  search  for  a  single  ideal  criterion. 

Admissibility  Criterion 

Consider  (b) .  A  decision  x'  is  said  to  be  admissible  (with 

respect  to  X  and  B)  if  x'  e  X  and  if  there  exists  no  other 
decision  x"  e  X  such  that  f(x",3)  >  f(x',3)  for  all  3  e  B,  with 
strict  inequality  holding  for  some  value  of  3  €  B.  If  such  a  decision 
x"  did  exist,  it  would  be  said  to  dominate  x'  (one  may  also  define 
weak  dominance  by  dropping  the  proviso  that  strict  inequality  must 
hold  for  some  value  of  3)*  The  admissibility  criterion  requires 
that  one  choose  an  admissible  decision.  In  other  words,  if  a(x) 
is  defined  to  be  equal  to  0  if  x  is  admissible  and  equal  to  -1 
if  x  is  inadmissible,  (b)  is  reformulated  as: 

(^.l)  Maximize  a(x)  . 

x  e  X 
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The  difficulties  with  this  criterion  arc  twofold:  the  set  of 
admissible  decisions  may  be  onerous  to  determine  computationally,  and 
this  set  may  be  quite  a  large  subset  of  X. 

Maxmin  Payoff  Criterion 

A  conservative  decision-maker  might  invoke  the  maxmin  payoff 
criterion,  which  yields 

(4.2)  Maximize  [  Inf  f(x,P) J  . 

x  e  X  3  e  B 

The  corresponding  criterion  in  terms  of  regret  is  known,  of  course, 
as  the  minmax  regret  criterion. 


Estimate  Criterion 

The  estimate  criterion  requires  that  one  pick  a  value  for  Ji, 

a  a  5/ 

say  P,  and  then  act  as  though  P  were  the  true  value  of  3.—' 

That  is,  solve 

(4.3)  Maximize  f(x,^)  . 

x  e  X 

A 

Since  £  may  be  chosen  to  be  any  point  in  B,  we  see  that  we 
really  have  a  whole  family  of  criteria. 


— '  This  criterion  is  included  in  order  to  formalize  the  common  practice 
of  using  judgmental  or  engineering  approximations  to  costs  and  other 
parameters  of  decision  models.  The  notion  of  an  estimate  is  related 
to  the  idea  of  a  certainty  equivalent,  which  will  be  discussed  at  the 
end  of  subsection  3-2.  It  should  be  noted  that  this  criterion  may 
also  be  invoked  when  0  is  regarded  as  a  random  variable,  and  in 
fact,  the  expected  value  of  P  is  a  popular  estimate. 
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The  computational  aivuhtages  this  apj  roach  ;  rc  olv '  me.  I 


in  not  no  obvious  that  there  exintn  a  "good"  intimate*  in 
how  to  fir:  •  one. 


or 


The  Principle  of  Insufficient  Reason 

Assume  that  B  consists  of  a  finite  number  (k)  of  elements, 
each  denoted  by  Then  the  Principle  of  Insufficient  Reason  asserts 

that  one  should  replace  (4)  by 

_  a 

k  i 

(4.4)  Maximize  -4  Y  f(x,P  ) 

x  e  X  k  i=l 

—  •  0 

Comparison  of  Criteria 

The  above  decision  criteria  are  representative  of  the  methods 
which  have  been  proposed  in  an  effort  to  circumvent  uncertainty  in 
the  objective  function  in  the  absence  of  probabilities.  The  diffi¬ 
culties  of  selecting  one  criterion  which  satisfies  all  of  a  compre¬ 
hensive  set  of  intuitively  appealing  desiderata  for  "rational" 
decision-making  are  well-known  (see,  e.g.,  Luce  and  Raiffa,  1957; 
Chapter  13) ,  and  suggest  the  futility  of  seeking  an  ideal  criterion. 

One  possible  way  out  of  this  dilemma  is  to  consider  several  criteria 
at  once,  and  thus  to  reformulate  (4)  as  a  vector  maximum  problem. 

The  actual  choice  of  a  decision  would  be  made  on  an  ad  hoc  basis 
from  the  set  of  efficient  solutions. 

Table  1  defines  a  decision  problem  in  which  there  are  four 
possible  values  of  (3,  and  five  possible  decisions.  The  entries 
give  the  values  of  f(x^,P^)  and  the  consequences  of  each  possible 
decision  in  terms  of  average  payoff  (on  which  the  Principle  of 
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Insufficient  Reckon  1.  i  ur  l)  anu  In  terms  of  minimum  payoff  (on 
which  the  mnxmin  payoff  criterion  is  based).  Figure  3  gruphs  these 
consequences. 

All  decisions  are  admissible.  The  Principle  of  Insufficient 
Reason  would  lead  to  the  choice  of  decision  number  two,  while  the 
maxmin  payoff  criterion  leads  to  the  fifth  decision.  However,  it 
seems  reasonable  to  favor  the  fourth  decision  over  any  of  the  others 
because  it  comes  very  close  to  satisfying  both  of  the  above  criteria. 

We  submit  that  by  judicious  choice  of  two  criteria  the  resulting 
vector  maximum  reformulation  of  (4)  can  be  expected  to  lead  to  a  more 
satisfactory  decision  than  a  single  criterion. 

5. 2  Reformulations  Involving  Probabilities 

With  the  additional  assumption  that  p  may  be  regarded  as  a 
random  variable,  one  may  choose  to  regard  (4)  as  a  continuous  game 
in  normal  form.  This  viewpoint,  and  the  consequent  game- theoretic 
solutions,  will  not  be  considered  here.  Instead  it  will  be  assumed 
that  P  has  a  known  probability  distribution  u  over  B  and  so 
(4)  may  be  regarded  as  a  game  against  a  neutral  "Nature."  That  is, 
we  are  in  what  is  sometimes  known  as  a  situation  of  individual  decision¬ 
making  under  "risk. " 

The  principal  tenet  of  utility  theory  (an  excellent  summary  is 
given  in  Luce  and  Raiffa,  1957 >  Chapter  2)  is  that  for  a  "rational" 
decision-maker  there  exists  a  utility  transformation  of  f,  which 
we  denote  by  u(f),  such  that  the  most  preferred  decision  is  an 
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optimal  solution  of: 


Maximize  E[u(l‘(x,0))J  . 
x  e  X 

If  one  accepts  any  of  the  sets  of  axioms  of  rational  behavior  leading 
to  this  result,  then  the  maximum  expected  utility  criterion  is  justified 
provided  that  the  required  utility  transformation  is  at  hand. 

Unfortunately  it  may  be  very  tedious  actually  to  determine  u(f). 
For  this  reason  ^and  also  because  of  certain  reservations  which  we 
have  with  regard  to  the  axioms  of  utility  theory),  we  shall  consider 
other  criteria  which  can  be  applied  directly  to  ffx,f3)  without  the 
need  for  a  utility  transformation.  We  begin  by  introducing  a  natural 
analog  of  the  admissibility  criterion. 

Stochastic  Admissibility  Criterion 

For  fixed  x,  p  induces  a  probability  distribution  on  f  which 
may  be  plotted  in  cumulative  form  as  in  Figure  4  (each  curve  represents 
the  cumulative  distribution  function  of  f  corresponding  to  different 
values  of  x)  .  Loosely  speaking,  one  wishes  to  perform  (4)  by  choosing 
an  x  which  determines  a  c.d.f.  that  is  uniformly  as  low  (or,  equiva¬ 
lently,  as  far  to  the  right)  as  possibie.  In  Figure  4  it  is  clear  that 
the  c.d.f.  determined  by  x^  must  be  strictly  preferred  to  that  of 
x^,  while  x^  need  not  be  preferred  to  Xy  Observe  that  although 
the  probability  density  functions  determined  by  x„  and  x^  overlap, 
the  c. d.  f .  '  s  do  not. 

We  formalize  the  above  ideas  in  terms  of  the  concept  of  stochastic 
lominance.  A  decision  x°  is  said  to  stochastically  dominate  x' 
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if  Prob[f(x°,P)  <  k]  <  Prob[f(x',p)  <  k]  for  all  real  k,  with 
strict  inequality  holding  for  at  least  one  value  of  k  (if  we  drop 
the  proviso  that  strict  inequality  must  hold  for  at  least  one  value 
of  k,  then  we  use  the  term  weak  stochastic  dominance).  If  a  feasible 
decision  is  not  stochastically  dominated  by  any  other  feasible  decision, 
it  is  said  to  be  stochastically  admissible.—^  The  stochastic  admissi¬ 
bility  criterion  requires  that  one  choose  a  stochastically  admissible 
decision  (this  criterion  can  be  written  in  a  form  similar  to  (4.1)). 

Remark :  Although  we  do  not  choose  to  do  so  in  this  paper,  it  is  possible 
to  strengthen  the  stochastic  admissibility  criterion  somewhat 
by  permitting  randomized  decisions  over  X.  One  would  say 
that  the  feasible  decision  x'  is  stochastically  inadmissible 
under  a  randomized  decision  strategy  if  there  exists  a  proba¬ 
bility  distribution  \  on  X  not  involving  x'  such  that 
Prob  ( f(x,3)  <  k]  <  Prob  [f(x',P)  <  k]  for  all  k,  with 

—  —  ~  g  —  — 

strict  inequality  holding  for  at  least  one  value  of  k.  For 
example,  in  Figure  4,  x^  is  stochastically  dominated  by 
the  randomized  strategy  which  chooses  and  x^  each  with 

a  probability  of  one-half,  even  though  neither  x^  nor 
stochastically  dominate  x^  alone.  Randomized  decision 
rules  have  the  effect  of  taking  vertically  convex  combina¬ 
tions  of  the  c.d.f. 's.  It  is  clear  that  the  set  of 


—  Since  stochastic  admissibility  is  defined  in  terms  of  X  and  the 
particular  distribution  p,  to  be  precise  we  should  qualify  stochastic 
admissibility  as  being  "with  respect  to  X  and  p."  We  omit  this 
qualification  for  the  sake  of  brevity,  since  no  confusion  is  likely  to 
result  in  our  discussion. 
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stochast i cu.l ly  admissible  decisions  allowing  randomized 
strategies  is  contained  in  the  set  of  stochastically  admissible 
decisions  allowing  only  pure  strategies. 

We  now  explore  the  relationship  between  ordinary  and  stochastic 
admissibility. 

Proposition  1: 

Let  |i  vanish  outside  of  B.  If  x°  weakly  dominates  x' , 

then  x°  weakly  stochastically  dominates  x'. 

Proof:  We  must  show  that  for  all  real  k,  Prob[f(x°,0)  <  k] 

<  Prob[f(x',p)  <  k].  By  the  definition  of  (non-stochastic)  weak 
dominance,  we  have  f(x',p)  <  f(x°,p)  for  all  0  e  B.  Thus  for  any 
fixed  value  of  k,  f(x°,3)  <  k  implies  f(x',0)  <  k,  and  so  for 
each  k  we  have 

(P  e  B:  f(x°,0)  <  k)  £{0  e  B:  f(x',P)  <  k)  . 

The  proposition  follows. 

Remark :  To  see  that  the  converse  of  this  proposition  need  not  hold, 
consider  the  following  example.  X  =  (x°,x^),  B  =  {p\p2), 
fCx0,?1)  ^  f(x\p2)  =  1,  f(x°,02)  =  fCx1,?1)  =  2, 

Prob[0  =  0  ]  =  .2  y  Prob[0  =  0  ]  =  .8.  Then  x°  stochasti¬ 
cally  dominates  t  but  x°  does  not  weakly  dominate  x\ 

With  additional  hypotheses,  one  may  strengthen  Proposition  1. 
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Proposition  2: 


? 


Let  f(x,0)  be  continuous  on  B  Tor  each  x  l  X,  nn  i  let 

7/ 

|i  be  positive—  everywhere  on  and  vunish  outside  of  B.  If 
x°  dominates  x',  then  x°  stochastically  dominates  x'. 

Proof:  From  Proposition  1  we  have  that  x°  weakly  stochasti¬ 
cally  dominates  x'.  It  remains  to  show  that  Prob[ f(x°,p)  <  k* ]  < 
Prob[f(x',£)  <  k*]  for  some  k*.  Since  x°  dominates  x',  there 
exists  0*  c  B  such  that  f(x°,P*)  >  f(x',^v).  Put  k*  - 
l/2(f(x°,0*)  +  f(x',P*))*  By  the  continuity  of  f  there  is  a  neigh¬ 
borhood  N*  of  3*  such  that  f(x°,0)  >  k*  >  f(x',3)  for  all 
0  €  N*  O  B,  and  so  by  the  positivity  of  u  on  B  we  have 
Prob[ f (x°>3)  >  k*  >  f(x’ ,0) ]  >  0,  This  fact,  with  the  definition 
of  x°,  yields 

Prob[f(x',0)  <  k*]  =  Prob[f(x',0)  <  k*  <  f(x°,0)  ]  4 

Prob[f(x’,0)  <  k*  >  f(x°,0)  ] 

=  Prob[f(x',0)  <  k*  <  f(x°,0)J  +  Prob[f(x°,0)  <  k4] 

>  Prob[f(x°,0)  <  k*]  . 


7/ 

—  A  probability  distribution  is  said  to  be  positive  everywhere  on 
B  if  for  each  0°  e  B  then  for  every  (b-dimensional )  neighborhood 
N°  of  0°  the  event  [If  ’Ob]  has  a  non-zero  probability,  A  neigh¬ 


borhood  of  (3  of  radius  p  is  defined  as 


[W&  p]  - 


and  is  denoted  by  N^(0  )  when  a  complete  notation  is  desired. 
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Proposition  ?  shows  that,  under  the  given  assumptions,  the  set 
of  stochastically  admissible  decisions  is  contained  in  the  set  of 
admissible  decisions,  as  one  would  expect  and  hope.  To  see  that  the 
set  of  stochastically  admissible  decisions  can  be  considerably  smaller 
than  the  set  of  admissible  decisions,  consider  the  example 

Maximize  [10  -  (3  -  x)^]  , 

_1 

x  €  R 

_  2 

where  u  is  the  Normal  distribution  with  mean  3  and  variance  a  , 

and  B  =  r\  Viewing  the  objective  function  as  a  family  of  functions 

of  3  indexed  by  x,  this  family  is  seen  to  consist  of  concave 

parabolas  which  are  identical  except  for  the  axis  of  symmetry,  which 

o  1 

occurs  at  (3  =  x.  Clearly  every  x  e  R  is  admissible,  for 

f(x°,p  =  x°)  =  10  >  f(x,B  =  x°)  for  all  x  ^  x°.  It  is  also  clear 
that  x'  ^  3  is  stochastically  inadmissible,  for  Prob[f(3,B)  <  k]  < 
Prob[f(x',B)  <  k]  for  all  k.  To  see  this  assertion,  observe  that 
(f3:  f(x,B)  >  k}  is  an  interval  of  width  2(l0-k centered  at 
(3  =  x.  By  the  symmetry  and  unimodality  of  the  Normal  distribution, 
the  interval  centered  at  3  =  3  must  include  the  greatest  probability 
for  any  k,  and  hence  Prob[f(3>3)  >  k]  >  Prob[(x',p)  >  k]  when 
x'  /  B,  which  is  equivalent  to  the  assertion  that  x'  ^  (3  is 
stochastically  inadmissible.  Since  x  =  3  is  stochastically  admissible, 
we  see  that  only  x  =  3  is  stochastically  admissible,  whereas  all  x 
are  admissible. 


The  Maximum  a-Fractile  and  the  Aspiration  Criteria 

In  terms  of  Figure  4,  we  would  like  to  choose  a  decision  which 
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achieves  the  lower  envelope  of  c.d.f. 's  everywhere.  In  general  this 
is  impossible,  but  we  can  attempt  to  achieve  it  at  a  single  point  and 
hope  that  this  one  point  will  "pin  down"  a  c.d.f.  so  that  it  is  close 
to  the  lower  envelope.  The  point  may  be  specified  in  terms  of  its 
ordinate  or  abcissa  value,  whichever  seems  most  natural  in  a  given 
problem  context.  The  criteria  implied  by  this  idea  are,  respectively 
and  loosely: 

Criterion  F:  Choose  an  x  which  corresponds  to  a 
c.d.f.  which  approaches  the  lower  envelope  of  c.d. f. ;s 
at  an  ordinate  value  of  a(0  <  a  <  l) . 

Criterion  A:  Choose  an  x  which  corresponds  to  a 
c.d.f.  which  approaches  the  lower  envelope  at  an  abcissa 
value  of  M(-°°  <  M  <  °°) . 


It  is  evident  that  v/e  have  two  entire  families  of  criteria  here,  indexed 
by  a  and  M  respectively.  Criterion  F  with  a  =  0.1  would  lead 
to  the  choice  of  x 2  in  Figure  4,  and  Criterion  A  with  M  =  20  would 
lead  to  the  choice  of  xJ| , 

8  / 

Criterion  F  is  equivalent  to  maximizing  the  a-fractile-' of  the 

distribution  of  f(x,£)  under  u.  That  is,  it  maximizes  the  payoff 

9/ 

level  below  which  there  is  at  most  an  a  probability  of  falling.— 


■try - 

—  We  define  the  a-fractile  of  a  (possibly  mixed)  cumulative  distri¬ 
bution  function  F(y)  =  Prob[Y  <  y]  as 


Sup{k:  F(k)  <  a)  . 

— ^  See  Kataoka  (1965)  for  a  linear  programming  model  of  this  type. 
It  is  one  of  the  few  published  references  to  this  criterion. 
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It  corresponds,  for  fixed  0  <  Ot  <  1,  to: 

Maximize  k 
k,x 

(4.5)  subject  to  x  <■  X 

Prob[f(x,3)  <  k]  <  a  . 

When  a  is  small,  say  less  than  0.1,  this  criterion  should  appeal 
to  conservative  decision-makers  because  it  tends  to  control  the  lower 
tail  of  the  distribution  of  payoffs.  When  a  -  l/2,  (4.5)  maximizes 

the  median  of  the  distribution  of  payoffs,  of  course.  We  sometimes 
use  the  mnemonic  notation  F(a)  for  this  criterion. 

Criterion  A  is  equivalent  to  maximizing  the  probability  of  exceeding 
a  prescribed  "aspiration"  level  M  of  payoff  (see  Charnes  and  Cooper, 
1965,  for  an  application  to  linear  programming).  It  corresponds  to: 

(4.6)  Minimize  Problf(x,6)  <  M]  . 

x  e  X 

We  sometimes  use  the  notation  A(M)  for  this  criterion. 

Remark:  It  is  to  be  noted  that  all  cumulative  distribution  functions 
in  this  subsection  are  written  as  Prob[f(x,0)  <  k]  rather 
than  as  Prob[f(x,3)  <  k]  (regard  x  as  being  fixed). 

This  convention  is  followed  in  order  to  avoid  some  minor 
difficulties  which  would  be  encountered  by  these  two  criteria 
if  the  opposite  convention  were  adopted  and  the  c.d.  f.  's 


were  discontinuous. 


We  introduced  these  two  criteria  together  becuus 


of  their  intimate 


mathematical  relationship,  as  well  as  their  common  graphical  motivation. 
When  the  lower  envelope  is  attained  by  some  x  at  every  point,  and  is 
continuous  and  strictly  increasing,  it  is  geometrically  clear  that 
the  F  and  A  criteria  are  complementary  in  the  sense  that  for  every  a 
there  is  an  M  which  leads  to  the  same  set  of  decisions,  and  conversely. 
Without  such  assumptions,  however,  the  complementarity  is  weakened, 
as  we  shall  see  in  the  following  two  easy  propositions. 

Proposition  J>: 

(i)  Assume  that  criterion  1 (a°)  is  satisfied  by  ut  least  one 

decision.  Then  the  set  of  decisions  which  satisfy  criterion 

F(a°)  contains  the  set  of  decisions  which  satisfy  criterion 

A(M°),  where  M°  is  the  maximum  a°-fractile. 

(ii)  Assume  that  criterion  A(M°)  is  satisfied  by  at  least  one 

decision.  Then  the  set  of  decisions  which  satisfy  criterion 

A(M  )  contains  the  set  of  decisions  which  satisfy  criterion 

F(a°) ,  where  a°  ^  Min  Prob[  f(x,j3)  <  M°J. 

x  c  X 

Proof :  (i).  Let  x*  satisfy  F(a°),  and  let  M°  be  the  maximum 

a°-fractile.  If  x°  satisfies  A(M°),  then  Prob[  f(x°,f})  <M°]  < 
Prob[f(x*,3)  <  M°]  <  a°,  and  so  x°  must  also  satisfy  F(a°). 

(ii).  Let  x*  satisfy  A(M°) ,  and  let  a°  ^  Min 

x  e  X 

Prob[ f(x,0)  <  M°]  =  Prob[ <M°],  If  x°  satisfies  F(d°) , 
then  there  exists  k°  >  M°  such  that  Prob[  f(x°,3)  <  k°]  <  a°;  since 
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k°  >  MU,  we  have  Probf  f(x°,p)  <  M°  ]  <  Prob[  f(x°,|})  <  k°]  <  0£°, 
from  which  it  foil  owe  that  x°  must  satisfy  A(M°) . 

Proposition  4: 

(i)  If  x°  satisfies  criterion  F(dt°)  uniquely,  then  it 

satisfies  criterion  A(M°)  uniquely,  where  M°  is  the 
maximum  a°-fractile. 

(ii)  If  x°  satisfies  criterion  A(M°)  uniquely,  then  it 

satisfies  criterion  F(a°)  uniquely,  where 

a°  =  Prob[  f (x°,p)  <  M0]. 

Proof:  (i).  Suppose,  that  x°  does  not  satisfy  A(M°)  uniquely. 

Then  there  exists  x1  e  X,  x‘  r-  x°,  such  that  Prob[f(x',p)  <  M°]  < 
Prob[f(x°,p)  <  M°j,  which  contradicts  the  fact  that  x°  satisfies 
F(a°)  uniquely. 

(ii).  Suppose  that  x°  does  not  satisfy  F(a°)  uniquely. 

Then  there  exist  k°  >  M°  and  x'  e  X,  x'  /  x°,  such  that 

Probf  f(x'  ,6)  <  k°]  <  0:°  -  Prob[  f(x°,3)  <  M°J.  Since  k°  >  M°,  we 
have  Prob[f(x',p)  <  M°]  <  Prob[f(x',P)  <  k°],  and  so 
Prob[f(x',p)  <  M°]  <  Prob[f(x°,p)  <  M°j.  This  contradicts  the  fact 
that  x°  satisfies  A(M°)  uniquely. 

It  is  possible  for  criteria  F(a)  and  A(M)  to  lead  to  stochas¬ 
tically  inadmissible  decisions.  The  next  proposition  is  of  interest 
in  this  regard. 
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Proposition  5: 


(i)  If  x°  satisfies  criterion  F(0£°)  uniquely,  then  xJ 

also  satisfies  the  stochastic  admissibility  criterion. 

(ii)  If  x°  satisfies  criterion  A(M°)  uniquely,  then  x° 

also  satisfies  the  stochastic  admissibility  criterion. 

Proof:  (i).  In  view  of  part  (i)  of  Proposition  4,  to  prove  (i) 

it  is  sufficient  to  prove  (ii). 

(ii).  Let  x°  satisfy  A(M°)  uniquely,  so  that 
Prob[f(x°,3)  <  M°]  <  Prob[  f(y  ^  <  M°]  for  all  x  c  X,  x  /  x°. 

Suppose  that  x°  were  stochastically  inadmissible.  Then  there  would 
exist  x'  e  X,  x’  ±  x°,  such  that  Prob[f(x’,3)  <  k]  < 

Prob[ f(x°,3)  <  kj  for  all  k.  Lett  ing  k  =  M°,  one  would  obtain 
a  contradiction. 

Now  we  turn  to  the  relationship  between  the  maxmin  payoff  criterion 
and  the  maximum  a-fractile  criterion  with  a  =  0.  It  is  not  at  all 
surprising  that  under  mild  assumptions  these  criteria  are  in  fact 
equivalent,  i.e.,  the  same  decisions  satisfy  both. 

Proposition  6: 

Assume  that  f(x,3)  is  upper  semicontinuous-^  on  B  for  each 

x  e  X,  and  that  p  is  positive  on  and  vanishes  outside  of  B. 

Then  the  maxmin  payoff  criterion  is  equivalent  to  the  maximum 

0-fractile  criterion. 

Let  x  be  fixed  in  X.  Then  f(x,3)  is  upper  semicontinuous 
at  3°  c  B  if  for  each  e  >  0  3  6  >  0  (depending  on  3°  and  e)  such 
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Proof:  We  shall  rewrite  (4.2)  and  (4.5)  in  such  a  way  as  to 
emphasize  their  similarity,  and  then  show  that  they  are  In  fact 
identical . 

The  maxmin  payoff  criterion  can  be  written^/ 

Maximize  [Sup(k:  f(x,p)  >  k,  V  P  e  B|)  , 

X  €  X 

and  the  maximum  O-fractile  criterion  can  be  written 

Maximize  [Sup(k:  Prob[f(x,0)  >  k]  =  1)]  . 
x  c  X 

Define  S^(x)  and  S2(x)  to  be  the  sets  appearing  in  the  first  and 
second  problems,  respectively,  for  fixed  x.  Clearly  S^x)  QS^(x) , 

V  x  €  X,  for  p  vanishes  outside  of  B.  The  proof  will  be  complete 
when  we  show  that  S2(x)  ^S^x),  V  x  e  X. 

We  consider  a  fixed  x,  and  drop  the  x  arguments  from 
and  S^.  We  may  assume  that  S2  is  not  empty,  for  if  it  is 
empty  then  is  also  empty,  and  the  proof  is  complete.  Take 

k'  e  S2-  Suppose  that  k'  ft  S^.  Then  there  exists  p1  e  B  such 
that  f(x,B')  <  k'.  But  by  the  upper  semicontinuity  of  f(x,p)  there 
exists  a  neighborhood  N'  of  p1  such  that  f(x,p)  <  k'  for  all 

that  f(x,p)  <  f(x,0)  +  e  whenever  p  If  I  is  continuous, 

then  f  is  upper  semicontinuous.  Also,  recall  that  if  B  is  a  finite 
point  set  in  e"1  ,  then  f(x,p)  is  automatically  continuous  on  B. 

— ^  This  problem  follows  from  the  definition  of  'inf'  as  the  greatest 
lower  bound. 


28 


P  €  N'  Ob-  By  the  positivity  of  4  on  B,  this  contradicts  the 
fact  that  k'  e  S^. 

The  F  and  A  criteria  have  the  interesting  property  that  one  may 
perform  a  continuous  monotonic  transformation  on  f(x,|3}  without 
altering  the  decisions  which  satisfy  these  criteria.  This  certainly 
is  not  true  of  the  next  criterion  we  shall  discuss,  the  expected 
value  criterion.  We  emphasize  this  point  in 

Proposition  7: 

Let  g(t)  be  any  strictly  increasing  and  continuous  function 
defined  from  into  R^.  Then  (i)  the  set  of  decisions  which 

satisfy  criterion  F(a)  does  not  alter  if  f(x,£)  is  replaced 
by  g(f(x,P)) ,  and  (ii)  the  set  of  decisions  which  satisfy  criterion 
A(M)  does  not  alter  if  f(x,B)  is  replaced  by  g(f(x,3))  and 
M  is  replaced  by  g(M)„ 

Proof:  Observe  that  fvx,6)  <  k  if  and  only  if  g(f(x,|}))  <  g(k), 
since  g  is  invertible  and  strictly  increasing.  Hence  O:  f(x,p)  <  k) 
(0:  g(f(x,0))  <  gfk)},  and  so  Probl  f(x,P)  <  k]  =  Probf  g(f(x,0) )  < 

g(k)  J.  This  yields  (ii).  To  see  (i),  write 

Sup(k:  Prob[f(x,0)  <  k]  <  al 

=  Sup(k:  Prob[ g( f (x,B) )  <  g(k)  ]  <  aj 
=  Sup{g_1(g(k)) :  Prob[g(f(x,f3) )  <  g(k)  ]  <  a) 

=  g‘1(Suplg(k) :  Prob[g(f(x,p))  <  g(k)  ]  <  a}) 

=  g‘1(Sup(t:  Prob[g(f(x,p))  <  t]  <  a:})  . 
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Finally, 


Max  [Sup{k:  Prob[  i'(x,J3)  <  k]  <  a}] 
x  c  X 

-  g‘1(  Max  [ Sup ( k :  Prob[ g( f(x,|i) )  <  k]  <at)J)  . 
x  e  X 

Maximum  Expected  Payoff  Criterion 

The  F  and  A  criteria  ure  designed  to  achieve  the  lower  envelope 

of  the  family  of  c.d.f. ’s  lPrub[  f(x,|3)  <  k])..  v  at  a  single  point, 

*“■  X  f  A 

in  an  attempt  to  "pin  down"  a  c.d.f.  to  lie  "close" to  the  lower 
envelope.  Another  approach  would  be  to  use  the  area  above  the  lower 
envelope  and  below  a  candidate  c.d.f.  as  a  measure  of  "closeness." 

Criterion  E:  Choose  an  x  e  X  which  determines  the 
c.d.f.  with  the  least  area  below  it  and  above  the  lower 
envelope. 

We  shall  show  now  that  this  geometrically  motivated  criterion 
is  equivalent  to  the  maximum  expected  payoff  criterion: 

(U.7)  Maximize  E[f(x,|3)]  . 

x  t  X 

Proposition  8: 

Criterion  E  is  equivalent  to  the  maximum  expected  payoff  criterion. 

Proof :  The  proof  is  a  simple  consequence  of  the  geometric  inter¬ 
pretation  of  the  mean  of  a  random  variable  in  terms  of  the  graph  of 
its  cumulative  distribution  function.  In  Figure  5,  the  mean  of  the 
random  variable  Y  is  area  1  minus  area  2  (see  Parzen,  i960,  p.  21l). 
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Denote  by  A(x)  the  area  corresponding  to  area  1  ol‘  Figure  b 
tor  the  c.d.i*.  Prob[f(x,£)  <  kj,  and  by  A(x)“  the  area  corres¬ 
ponding  to  area  2.  Similarly,  denote  by  A  and  A  the  areas  abov- 
and  below  the  lower  envelope  of  all  such  c.d.f. 's.  The  the  maximum 
expected  payoff  criterion  may  be  written 

Maximize  [A(x)+  -  A(x)~]  , 
x  e  X 

and  Criterion  E  may  be  written 


Minimize  [  (A(x)  -  A  )  +  (A  -  A(x)*)  ]  . 

x  e  X 

Clearly  these  two  problems  lead  to  the  same  decisions. 


Figure  5 

There  is  an  obvious  and  fortunate  relationship  between  the  maximum 
expected  payoff  criterion  and  the  estimate  criterion  which  sometimes 
permits  one  to  choose  an  estimate  in  a  simple  way  so  that  the  estimate 
criterion  is  satisfied  by  the  same  set  of  decisions  as  the  expected 
payoff  criterion. 
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<ca| 


Proposition  9* 


Assume  that  f(x,|l)  can  be  written  as 

f(x,£)  =  F  (x)  +  F2(P)  +  £  H.(x)p.  . 

i 

A 

Then  the  estimate  criterion  with  |3  =  E[pJ  is  satisfied  by  the 
same  set  of  decisions  as  the  maximum  expected  payoff  criterion. 

Proof:  The  maximum  expected  payoff  criterion  gives 

Maximize  e[f, (x)  +  F5(P)  +  £  H.(x)P,  |  ,  or 
x  e  X  L  i  1-11 

Maximize  I”  F1(x)  +  E[F2(p)  ]  +  £ 
x  e  X  L  i 

A 

The  estimate  criterion  with  £  =  E[0]  gives 

Maximize  [  F  (x)  +  F  (E[pJ)  +  £  H  (x)  E[ p1 ] 

X  €  X  L  i 

Since  the  F^  terms  of  each  problem  do  not  contain  x,  they  may 
be  deleted,  and  hence  the  two  criteria  lead  to  identical  sets  of 
decisions. 

When  the  above  proposition  applies,  we  say  that  the  estimate 
=  E[(3]  is  a  certainty  equivalent  with  respect  to  the  maximum 
expected  payoff  criterion.  Other  results  in  the  same  vein  are  given 
by  Reiter  (1957) >  Simon  (1956),  and  Theil  (1964). 

It  is  easy  to  see  from  Proposition  8  that  any  decision  which 
satisfies  the  maximum  expected  payoff  criterion  must  be  stochastically 
admissible. 


(x)  Etp1]  . 
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It  is  also  wor*h  noting  tlr.it  the  expecte 1  vujue  criterion  b-ais 
to  the  same  decisions  when  applied  to  puyolT  as  when  applied  to  regret. 
In  general  this  is  not  true  for  criteria  A(M)  and  F(a) . 


3.3  An  Example 

We  present  a  simple  inventory  model  as  an  illustration  of  the 
ideas  of  this  section  and  as  a  vehicle  for  further  discussion.  Consider 
a  firm  stocking  and  selling  a  single  commodity  for  a  single  period  of 
time.  We  use  the  notation 


x  = 

P  = 

c  = 

r  = 

v  = 
f(x,0)  - 
X  = 
B  - 


number  of  units  to  be  ordered  in  advance  of  the 
demand 

unknown  demand  level  during  the  period 

cost  per  unit 

revenue  per  unit  (r  >  c) 

salvage  value  per  unit  left  at  end  of  period  (v  <  c) 
total  profit 
[0,®) 


[0>fW’  Where  PMAX  is 

to  account  for  the  largest 


chosen  sufficiently  large 
likely  demand 


The  payoff  and  regret  are  given  by 


f( 


x,P)  -  \ 


r(x,0)  = 


(r-c)0  -  (x-0) ( c-v) 

if 

0  <  X 

(r-c)x 

if 

0  >  X 

(c-v)  (x-{3) 

if 

0  <  X 

(r-c) (0-x) 

if 

0  >  X  . 
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First  we  examine  the  criteria  not  involving  probabilities  over 


the  set  of  possible  demand  levels.  All  choices  for  x  e  X  are  readily 

seen  to  be  admissible.  The  maxmin  payoff  criterion  leads  to  the  decision 

to  order  zero  units,  since  Min  f(x,p)  =  -(c-v)x.  When  this  criterion 

(3  e  B 

is  applied  to  regret,  however,  it  (minmax  regret)  leads  to  the  decision 

to  order  [  (r-c)/(r-v)  This  is  the  same  decision  that  the 

Principle  of  Insufficient  Reason  would  give  if  we  interpret  it  as 

putting  a  uniform  distribution  over  ^  0 , ^MAX ^ *  '^ie  es^^ma^e  criterion 

A 

leads  to  a  trivial  maximization  problem  once  an  estimate  p  is  chosen, 

A 

and  indicates  that  we  should  order  exactly  x  =  p. 

Next  we  examine  the  criteria  involving  probabilities  over  the  set 
of  possible  demand  levels.  In  order  to  plot  the  cumulative  distri¬ 
butions  of  payoff  for  various  candidate  x's,  we  need  to  know  the 
set  of  P's  for  which  the  payoff  is  less  than  k. 


0  if  k  <  -(c-v)x 

(P:  p  >  0,  f(x,p)  <  k)  =(  [o,  — *-fc:v)x|  if  -(c-v)x  <  k  <  (r-e): 


[0,®) 


if  k  >  (r-c)x  . 


Using  the  fact  that  x  is  non-negative,  we  have  for  k  >  0 


Prob[  f  (x , p)  <  k]  = 


if  x  < 


(r-c) 


1  -  I  dp  if  x  >  f  \ 

Jk+(C-v)x  -  ” 


For  k  <  0, 


Prob[f(x,p)  <  k] 


0 


i 


dp 


k+(c-v)x 


if 


x  < 


-k 

(c-v) 


if 


x  > 


-k 

(c-v) 


The  lower  envelope  may  be  obtained  by  solving,  for  all  real  k, 
the  problem 

Minimize  Prob[f(x,p)  <  k]  . 
x  >  0 


This  problem  has  a  very  simple  solution  for  this  example.  For  k  <  0, 
the  minimum  is  zero  and  is  achieved  for  0  <  x  <  |k|/(c-v).  For  k  >  0, 

Jr°° 

dp  and  is  achieved  for  x  -  k/(r-c). 

k/(r-c) 

Assume  for  computational  simplicity  that  the  demand  is  exponen¬ 
tially  distributed  with  mean  10,  that  (c-v)  =  l/2,  and  that 

(r-c)  =  3/2.  Then  for  k  >  0,  the  lower  envelope  has  height 

12/ 

[1  -  exp[-.066£  k]],  and  is  achieved  at  x  =  2k/3. —  Figure  6 

illustrates  the  lower  envelope  and  a  few  sample  c.d.f. 's.  Observe 
that  each  c.d.f.  jumps  to  the  value  1  as  soon  as  it  attains  the  lower 
envelope,  and  that  every  x  >  0  is  stochastically  admissible. 

We  are  now  in  a  position  to  read  off  the  "optimal"  decisions 
corresponding  to  criteria  A(M)  and  F(a)  for  any  choice  of  M 
or  a.  A(M°)  leads  to  the  unique  choice  of  x  =  M°/(r-c),  and 
F(0£°)  leads  to  the  unique  choice  x  =  -10  ln(l-ato).  In  this 
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— Not'  that  the  lower  envelope  is  the  c.d.f.  of  an  exponential 
distribution  with  mean  15. 
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particular  example,  these  criteria  io  not  fulfill  their  promise  of 
"pinning  down"  a  c.d.f.  to  lie  close  to  the  lower  envelope,  beeuuse 
each  c.d.f.  is  discontinuous  at  tne  point  at  which  it  achieves  the 
lower  envelope. 

The  maximum  expected  payoff  criterion  may  be  applied  by  setting 
the  derivative  of  E[f(x,3)j  equal  to  zero  and  solving  for  x. 

This  computation  leads  to  the  well-known  (Dvoretzsky,  Kiefer,  and 
Wolfcwitz,  1952)  result  that  one  should  choose  the  value  of  x 
corresponding  to  the  (r-c)/(r-v)- th  fractile  of  p.  That  is, 

fX* 

x*  should  satisfy  /  dp  =  (r-c)/(r-v).  For  the  data  assumed  above, 

Jo 

x*  =  13.8.  It  is  interesting  to  observe  that  if  p  were  uniform 
on  then  the  minmax  regret  criterion  would  lead  to  exactly 

the  same  action  as  would  the  maximum  expected  payoff  criterion. 

Next  we  carry  out  a  parallel  analysis  in  terms  of  regret  rather 
than  payoff  ,  It  will  be  seen  that  A(M)  and  F(a)  are  more 
appealing  when  applied  to  the  regret  distributions.  An  argument  will 
be  presented  for  choosing  a  value  of  x  other  than  that  which  mini¬ 
mizes  expected  regret  (which,  of  course,  is  equivalent  to  maximizing 
the  expected  payoff,  the  now  classical  solution  to  this  problem). 

We  have,  for  k  >  0, 

(3:  3  >  0,  r(x,3)  <  k)  ~ 


Since  we  are  dealing  in  tc-rms  of  repr-’  •  ,  rather  than  payoff,  we  seek 
the  upper  envelope  ru*  her  'hv  'tie  .  ower  envelope.  It  is  obtained  by 


x  *T7^r] 

if 

x  < 

k  ^  k  1 

-  -  ,  X  +  - 

c-v  r-c  1 

if 

X  > 

k 

(c-v) 

k 

(c-v) 
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vix  r 


it. 


or 


I  r  ! 1  [ 


r '  x , 


Maxim  i/.c 
x  >  0 


-in 


Since  the  exponential  distribution  is  monotone  decreasing,  the  maximum 
is  easily  seen  to  be  achieved  at  x  =  k/(e-v).  The  height  of  the 
upper  envelope  is  therefore  equal  to  Prob[f3  <  k/(c-v)  +  k/(r-c)]. 

For  the  data  given  previously,  this  quantity  is  computed  to  be 
[  l-exp(-0. 266£  k) ],  and  the  upper  envelope  is  achieved  for  x  =  2k. 

Figure  7  is  the  counterpart  of  Figure  6.  Note  that  the  c.d.f. 's 
are  continuous,  so  that  A(M)  and  F(a)  are  more  effective  in  their 
endeavor  to  "pin  up"  a  c.d.f.  to  lie  near  the  upper  envelope. 

For  a  given  value  of  x,  it  is  a  straightforward  matter  to  calcu¬ 
late  the  expected  regret  and  the  a-fractile.  This  has  been  done 
for  a  ^  .95  and  some  representative  values  of  x  in  Figure  8.  The 
striking  feature  of  this  graph  is  that  large  relative  changes  in  .95- 
fractile  are  available  with  only  small  relative  changes  in  expected 
regret,  with  the  result  that  it  becomes  attractive  to  deviate  from 
the  ordinary  minimum  expected  regret  solution  to  the  problem.  For 
example,  consider  x  =  13.8  (which  yields  the  minimum  expected  regret) 
in  comparison  with  x  =  20.  The  former  has  an  expected  regret  of 
6.9  and  a  .95-fractile  of  24.1,  whereas  the  latter  has  an  expected 
regret  of  7*7  and  a  .95-fractile  of  14.8.  That  is,  by  choosing  x  =  20 
instead  of  13*8,  one  may  achieve  a  38*5$  decrease  in  .95-fractile  at 
the  expense  of  only  11.6$  increase  in  expected  regret;  for  x  =  l8 
instead  of  13.8,  the  percentages  become  26.1$  and  5*9$* 
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•95-FRACTII£  of  regret  distribution 


Figure  8 
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This  example  shows  u  special  instance  of  what  is  likely  to  be 
a  quite  general  situation:  in  the  neighborhood  of  the  decision  indicated 
by  the  maximum  expected  payoff  criterion,  it  is  possible  to  substan¬ 
tially  improve  the  a-fractile  or  aspiration  levels  of  payoff  or  regret 
without  lowering  the  expected  payoff  very  much.  Such  possibilities 
ought  to  be  investigated  and  exploited  when  found  to  be  relevant  to 
the  decision-maker's  objectives. 


3.4  Vector  Maximum  Reformulations 

The  "ideal"  decision  criterion  is  analagous  to  the  much-sought 
philosophers 5  stone  of  medieval  times,  and  seems  about  as  likely 
to  exist.  We  suggest  that  one  might  profitably  consider,  in  a  given 
application,  two  or  even  three  plausible  criteria  (not  necessarily 
the  ones  discussed  herein)  and  reformulate  (4)  as  a  vector  maximum 
problem.  The  solution  of  this  vector  maximum  problem  would  reveal 
clearly  the  tradeoffs  involved  between  the  criteria,  and  a  decision 
may  be  chosen  in  an  ad  hoc  manner  from  the  efficient  candidates.  For 
example,  if  a  situation  such  as  Figure  9  occurs,  one  would  probably 
choose  an  efficient  solution  nearer  to  point  B  than  to  point  A,  for 
a  large  gain  in  criterion  2  can  be  achieved  at  t.he  expense  of  a  rela¬ 
tively  small  loss  in  criterion  1. 


Figure  9 
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Criterion  1 
(to  be  maximized) 


One  combination  of  criteria  which  seems  particularly  plausible 
when  a  probability  distribution  over  B  is  available  is  the  Ot-fractile 
criterion  with  the  expected  value  criterion.  With  a  small,  the 
first  criterion  tends  to  control  the  lower  tail  of  the  distribution 
of  payoffs,  while  the  second  tends  to  control  the  mean.  Such  a  com¬ 
bination  might  be  used  to  program  a  mutual  investment  fund,  for  example, 
for  the  possibility  of  ruin  or  large  losses  seems  to  loom  as  a  separate 
dimension  of  utility  from  the  average  growth  rate.  Markowitz  (1956) 
had  precisely  this  viewpoint  in  mind  for  his  well-known  portfolio 
problem,  except  that  he  used  variance  in  place  of  the  a-fractile. 

Hodges  and  Lehmann  (1952)  proposed  essentially  this  combination 
of  criteria,  except  that  they  took  a  equal  to  zero.  Letting  a 
rise  above  zero  seems  to  avoid  sane  of  the  excessive  conservatism  in 
their  formulation,  while  keeping  the  aim  of  protection  against  large 
losses. 
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CHAPTER  II 


Reducing  a  Vector  Maximum  Problem  to  a 
Parametric  Programming  Problem 

In  this  chapter  it  is  assumed  that  uncertainty  has  been  removed 
from  a  decision  problem  by  means  of  devices  such  as  those  discussed 
in  the  first  chapter,  and  that  it  is  desired  to  solve  the  vector 
maximum  problem 

(l)  "Maximise"  f(x)  , 

x  c  X 

where  f(x)  =  ( f ^ (x) , .  . .  , f  (x) ) ,  x  is  an  n- vector,  and  X  is 
a  given  set  of  feasible  decisions.  Recall  that  "solving"  (l)  means 
finding  all  efficient  decisions,  where  a  feasible  decision  x°  is 
called  efficient  if  there  exists  no  feasible  decision  x'  such  that 
f(x')  >  f(x°).— ^  We  shall  discuss  two  ways  of  reducing  (l)  to  a 
parameterized  family  of  ordinary  (one  criterion  function)  mathematical 
programming  problems,  or  "parametric"  programming  problems.  Existing 
computational  methods  for  these  problems  will  be  indicated. 

This  chapter  is  intended  to  serve  as  a  bridge  between  the  study 
of  decision  problems  under  uncertainty,  which  was  the  topic  of  the 
first  chapter,  and  the  study  of  a  class  of  algorithms  for  parametric 
programming,  which  is  the  topic  of  the  third  chapter. 

'  Recall  that  by  this  notation  we  mean  f^(x')  >  f  (x°)  (i  =  l,...,r) 
with  f^(x')  >  f  (x  )  for  some  i  (see  Footnote  1,  Chapter  i). 


h 
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1.  Reducing  (l)  to  a  Problem  Parametric  in  the  Constraints 


From  the  definition  of  an  efficient  decision  for  (l),  it  is 
easy  to  see  that  a  feasible  decision  x°  is  efficient  if  and  only  if 
x°  is  an  optimal  solution  to  each  of  the  r  problems 

Maximize  f^(x) 

(21)  2  e  x 

subject  to  fj(x)  >  f  (x°)  ,  j  =  1,  ...  ,  r  but  J  ^  i  , 

i  =  l,...,r.  It  follows  immediately  that  the  following  assertion 
holds. 


Proposition  1; 

Let  1  <  iQ  <  r  be  fixed.  If  x°  is  efficient  in  (l),  then 
there  exists  an  (r-l) -vector  6  such  that  x°  is  an  optimal 
solution  of  (3iQ)>  where  (Ji)  is  given  by 


(3i) 


Maximize  f.(x) 
x  €  X  1  “ 

subject  to  f.(  x)  >  6.  ,  j  =  1,  ...  ,  r  but  j  ^  i  . 
J  J 


This  proposition  suggests  a  method  for  finding  all  efficient 
decisions.  Taking  r  =  L  and  i  =  1,  for  example,  we  find  the 
set  of  all  efficient  decisions  among  the  totality  of  optimal  solutions 
to 

Maximize  f.  (x) 

(3)  2  €  x 

subject  to  fgM  >  6 


as  6  varies  over  (-oo,-h»).  Often  f ^ (x)  is  bounded  from  above 
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on  X,  and  so  the  interval  of  parametric  variation  does  not  extend 
to  Likewise  when  f2(x)  is  bounded  from  below  on  X,  or  when 

the  maximum  of  f^(x)  on  X  is  achieved  for  some  value  of  x,  the 
interval  of  parametric  variation  need  not  extend  to 

This  method  yields  not  only  all  efficient  decisions,  but  possibly 
some  inefficient  ones  as  well,  since  it  may  be  possible  to  increase 
f2(x)  without  decreasing  f^x)  below  its  maximum  value  for  a  parti¬ 
cular  value  of  6.  A  similar  remark  holds  a  fortiori  for  r  >  2. 

Culling  out  the  inefficient  decisions  when  r  =  2  is  easily  done, 
in  principle,  by  viewing  the  graph  of  (f^(x),f2(x))  for  all  candi¬ 
date  decisions  generated  by  the  method.  For  r  >  2,  graphical  analysis 
rapidly  becomes  impract.  .1,  and  one  must  rely  on  sufficient  conditions 
such  as  those  given  in 

Proposition  2: 

Let  1  <  i  <  r  and  the  (r-l) -vector  6  be  fixed,  and  let 
-  o  —  -o 

x°  be  an  optimal  solution  to  (3iQ)  with  6  =  Bq.  If  any  of 
the  following  three  conditions  are  satisfied,  then  x°  is 
efficient  in  (l). 

(i)  x°  is  also  an  optimal  solution  of  the  r-l  problems 
(3i),  i  /  iQ,  with  6^  =  fjU°),  J  =  l,...,r. 

(ii)  x°  is  the  unique  optimal  solution  to  (3iQ)  with 

6  =  5. 

—  — o 

(iii)  x°  is  the  unique  optimal  solution  to  (3i  )  with 
6j  =  fj(x°),  j  i  i0- 
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Proof;  If  (i)  is  satisfied,  x°  is  efficient  in  (l)  by  the 


opening  remark  of  this  section. 

Assume  that  (ii)  is  satisfied,  and  suppose  that  x°  is  not 
efficient.  Then  there  exists  x'  e  X  such  that  f(x')  >  f(x°), 
which  implies  that  x'  is  feasible  and  optimal  in  (3iQ)  with 
6  *  thus  contradicting  the  unique  optimality  of  x°.  Hence 

x°  is  efficient. 

Since  x°  also  is  an  optimal  solution  of  (3iQ)  with  8^  =  fj(x°), 
the  argument  apropos  (ii)  applies. 

Under  additional  hypotheses,  Propositions  1  and  2  can  be  combined 
to  give 

|  Proposition  3: 

Let  1  <  i  <  r  be  fixed.  Assume  that  f<  is  strictly  concave, 

0  “  O 

p/  o 

fj(j  i  iQ)  is  concave,  and  X  is  convex.-  Then  x  is 
efficient  in  (l)  if  and  only  if  x°  solves  (3iQ)  for  some  (r-l)- 
vector  8. 

Proof:  Necessity  was  proven  in  Proposition  1.  To  prove  suffi¬ 
ciency,  apply  A. 2  of  Appendix  A  and  part  (ii)  of  Proposition  2. 

2.  Reducing  (l)  to  a  Problem  Parametric  in  the  Objective  Function 
We  shall  give  some  conditions  under  which  (l)  can  be  reduced  to 

27 

— '  See  Appendix  A  for  definitions  of  convex  sets  and  concave  functions, 
and  seme  properties  thereof  which  will  be  used  freely  in  the  sequel. 

I 
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a  family  of  problems  of  the  form 


r 

(4)  Maximize  £  v . T. (x)  , 

x  e  X  i=l 


where  v  >  0  is  a  .vector-valued  parameter. 


Proposition  4; 

(i)  If  v  >  0  and  x°  is  an  optimal  solution  to  (4),  then 

x°  is  efficient  in  (l). 

(ii)  If  v  >  £  and  x°  is  the  unique  optimal  solution  of 

(4),  then  x°  is  efficient  in  (l). 


Proof:  Suppose  that  (i)  is  false.  Then  there  exists  x'  e  X 
such  that  f(x')  >  f(x°)  *  since  v  >  0,  this  implies  that 
Jv  f  (x')  thus  contradicting  the  optimality  of  x° 


in  (4).  This  proves  (i). 

Suppose  that  (ii)  is  false.  Then  there  exists  x'  e  X,  x'  ^  x°, 
such  that  f(x')  >  f (x°) ;  since  v  >  0,  this  implies  that 
£vifi(x’)  >^vifi(x°),  thus  contradicting  the  unique  optimality 
of  x°  in  (4).  This  proves  (ii). 


Proposition  5:-^ 

Let  X  be  convex,  let  f^(x)  be  concave,  i  =  l,...,r,  and 
let  x°  be  efficient  in  (l).  Then  there  exists  an  r-vector 
v°  >  0  such  that  x°  is  an  optimal  solution  of  (4)  with  v  =  v°. 


-  The  earliest  statement  and  proof  of  a  theorem  of  this  type  seems  to 
be  due  to  Kuhn  and  Tucker  (1951).  An  elegant  proof  of  this  proposition 
has  been  given  by  Karlin  (1959;  p.  217).  For  the  sake  of  completeness 
we  record  a  slightly  different  version  of  that  proof  here. 
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Proof: 


Put  P  =  (jd  e  Er:  2  >  f(x°))*  Clearly  P  is  convex. 

Put  Z  =  (z  e  Er:  z  <  f(x)  for  sane  x  e  X).  Z  is  convex,  for 
let  z',z"  e  Z  and  let  0  <  \  <  1.  By  the  definition  of  Z  there 
exist  x',x"  e  X  such  that  z'  <  f(x')  and  z"  <£(*")•  Hence 

(\z 1  +  (l-\)z")  <  Xf(x')  +  (l-\)f(x")  <  f(\x'  +  (l-\)x")  , 

where  the  last  inequality  follows  from  the  concavity  of  f (x) .  Since 
(\x'  +  (l-\)x")  e  X  by  the  convexity  of  X,  ( \z '  +  (l-\)z")  e  Z. 

This  shows  that  Z  is  convex. 

Because  x°  is  efficient,  zOP  is  the  single  point  f(x°) , 
so  that  Z  and  P  have  no  interior  points  in  common.  Hence  we  may 
apply  the  well-known  Theorem  of  the  Separating  Hyperplane  (see  A. 7 > 
Appendix  A)  to  assert  the  existence  of  an  r-vector  v°  /  0  and  a 
scalar  c  such  that 

D  v°  zi  <  c  <  v°  p.  ,  Vz  e  Z,  p  e  P  . 

The  right-hand  inequality  and  the  definition  of  P  imply  that 
v°  >  0,  for  otherwise  the  sum  would  be  unbounded  from 

below.  By  the  definition  of  Z,  the  left-hand  inequality  yields 
£  v?  fi(x)  <  c,  Vx  e  X.  Taking  p  =  f(x°),  we  have  ^  v?  f^(x)  < 

£  v?  f^(x°),  Vx  e  X,  which  is  equivalent  to  the  assertion  that 
x°  is  an  optimal  solution  of  (4)  with  v  =  v°. 

When  the  hypotheses  of  Proposition  5  hold,  one  is  sure  to  find 
all  efficient  decisions  for  (l)  among  the  totality  of  optimal  decisions 
for  (4)  as  v  ranges  over  all  non-negative  values.  Notice  that 
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without  loss  of  generality  one  may  take  £  v^.  =  1  in  (4),  since  for 
fixed  v  >  0  the  objective  function  of  that  problem  can  be  scaled 
by  a  factor  of  1/  £  without  affecting  the  set  of  optimal  solutions. 
Hence  v  is  really  only  an  (r- l) -dimensional  parameter.  When  r  =  2, 
for  example,  (4)  reduces  to  the  parametric  problem 

(4.1)  Maximi7e  vf^x)  +  (l-v)  fg(x)  for  each  0  <  v  <  1  . 

x  e  X 

By  strengthening  the  hypotheses  of  Proposition  5,  the  last  two 
propositions  can  be  combined  to  give 

Proposition  6; 

Let  X  be  convex,  and  let  f^(x)  (i  =  l,...,r)  be  strictly 
concave.  Then  x°  is  efficient  in  (l)  if  and  only  if  x° 
solves  (4)  for  some  v  >  0. 

Proof:  Necessity  was  proven  in  Proposition  5.  To  prove  sufficiency, 
apply  A. 2,  A. 4,  and  part  (li)  of  Proposition  4. 

3.  Computational  Methods  for  Parametric  Problems 

A  very  common  approach  for  a  decision-maker  to  take,  when  faced 

with  solving  a  multi-criterion  problem  such  as  (l),  is  to  reformulate 

(l)  in  the  form  of  (3i)  or  (4)  (or  possibly  a  combination  of  the  two) 

with  5  or  v  fixed  at  some  value  of  particular  interest.  Problem 

(Ji)  corresponds  to  selecting  and  retaining  the  most  important  criterion 

function  and  putting  the  rest  in  as  constraints  so  that  the  remaining 

4/ 

criteria  each  meet  at  least  some  minimally  acceptable  level.—' 

- - 

-  For  an  early  and  important  example  of  this,  see  Neyraan  and  Pearson 
(1933);  who  employed  this  device  as  a  cornerstone  of  their  theory  of 
statistical  hypothesis  testing. 
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Problem  (h)  corresponds  to  maximizing  u  weighted  combination  of  criteria 
which  is  designed  to  reflect  the  relative  importance  of  each.  3uch 
an  approach  offers  computational  simplicity  in  comparison  with  a 
complete  solution  of  (l),  since  just  one  ordinary  maximization  problem 
has  to  be  solved.  After  (3i)  or  (4)  has  been  solved  for  the  selected 
6°  or  v° ,  the  value  of  6  or  *,  may  be  varied  in  a  neighborhood 
of  6°  or  v°  in  order  to  ascertain  how  the  corresponding  optimal 
decisions  and  payoff  function  vary.  This  is  a  type  of  "sensitivity 
analysis."  The  above  propositions  relate  this  type  of  sensitivity 
analysis  to  the  partial  solution  of  (l)  in  the  vector  maximum  sense. 

Whether  for  purposes  of  sensitivity  analysis  or  of  solving  (l), 
solution  methods  are  required  for  the  parametric  problems  associated 
with  (3i)  and  (4).  Since  analytic  methods  can  be  expected  to  have 
very  limited  applicability— if  experience  with  nor-parametric  mathe¬ 
matical  programming  is  any  guide— numerical  methods  must  be  employed. 

In  this  regard,  we  are  obliged  to  limit  our  consideration  to  problems 
for  which  X  is  convex  and  f^(x)  (i  -  l,...,r)  is  concave,  for 
most  known  programming  algorithms— ^  require  at  least  convexity  of 
the  feasible  region  and  concavity  of  the  objective  function.  We  shall 
further  limit  our  consideration  to  the  important  case  r  =  2,  because 
the  vastness  of  the  parameter  space  increases  so  rapidly  with  r  as 
to  preclude  the  reasonable  hope  of  solving  parametric  problems  even 
to  reasonable  approximation  when  r  is  much  larger  than  2  or  3. 

57 - 

—  For  surveys  of  (nonlinear)  programming  algorithms,  see,  e.g., 

Dorn  (1963) ,  Hadley  (1964),  Saaty  and  Bram  (1964,  Chapter  3);  Wolfe 
(1962),  and  Zoutendijk  (i960). 
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We  now  indicate  some  existing  computational  methods,  and  point  out 
the  need  for  the  developments  of  the  next  chapter. 

If  X  is  a  convex  polyhedron  (i.e.,  the  feasible  region  is 
determined  by  a  set  of  linear  equalities  or  inequalities),  then  several 
efficient  parametric  programming  algorithms  are  available  for  certain 
special  classes  of  criterion  functions:  when  f^  and  fg  are  both 
linear  functions,  parametric  versions  of  (3)  and  (4.1)  can  be  solved 
by  parametric  linear  programming  (Gass,  1955);  when  f^  is  linear 
and  f^  is  a  quadratic  polynomial,— ^  the  algorithms  of  Houthakker 
(i960),  Markowitz  (1956),  and  Wolfe  (1959)  are  available;-^  when  f^ 
and  f^  are  both  quadratic  polynomials,  an  algorithm  of  Zahl  (1964) 
essentially  solves  (4.1),  although  it  seems  possible  to  improve  upon 
the  efficiency  of  his  procedure  by  utilizing  the  developments  of  the 
next  chapter.  Little  if  anything  appears  to  have  been  done  to  devise 
efficient  algorithms  for  parametric  problems  involving  more  general 
classes  of  criterion  functions  or  feasible  regions  other  than  convex 
polyhedra.  The  class  of  algorithms  developed  in  Chapter  III  is 
intended  as  a  contribution  in  this  direction.  At  the  present  state 
of  the  art  of  parametric  programming,  however,  one  must  fall  back 
upon  more  rudimentary  methods. 

In  principle,  if  an  algorithm  is  available  which  will  solve 
(3i)  or  (4)  for  any  particular  value  of  the  parameter,  then  by 

That  is,  f2(x)  =  x^Qx  +  .cSc,  where  t  denotes  transpose  and  Q 
is  a  negative  semidefinite  matrix. 

See  also  Boot  (1963a,  1963b) . 
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employing  a  suitably  1‘ino  grid  of  parameter  values  one  can  obtain  a 

discrete  approximation  to  the  optimal  solutions  of  the  parametric 

problem.  This  is  a  very  straightforward  approach,  and  for  many 

problems  it  may  be  fairly  practical,  since  the  optimal  solution  for 

one  parameter  value  can  be  expected  to  provide  a  nearly  optimal 

solution  at  the  next  parameter  value  on  the  grid.  Because  most 

programming  algorithms  nay  be  viewed  as  gradient  methods,  this 

approach  should  provide  roughly  first  order  convergence  between 

optimal  solutions  at  adjacent  pairs  of  grid  points. 

In  the  next  chapter  we  offer  an  alternative  to  the  last  approach 

under  quite  general  assumptions  on  the  criterion  functions  and  the 

feasible  region.  We  shall  develop  a  class  of  algorithms  for  solving 

fl/ 

(U.l),  a  main  member  of  which  exhibits  second  order—'  convergence 
between  adjacent  pairs  of  grid  points. 

— ^  A  sequence  <  x'  >  which  converges  to  x°  exhibits  first  (second) 
order  convergence  if  the  norm  of  the  error  at  the  n-th  step  is 
asymptotically  proportional  to  the  (square  of  the)  norm  of  the  error 
at  the  n-lst  step  (see  Appendix  C,  section  l) .  * 
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CHAPTER  III 


A  Class  of  Algorithms  for  Parametric  Concave  Programming 

1.  Introduction  and  Preliminaries 

In  this  chapter  we  present  a  class  of  algorithms  for  solving  parametric 
concave  programming  problems  of  the  form 

Maximize  af^Tx)  +  (l-a)fg(x) 

(R*)  - 

subject  to  g(x)  >  0 

for  each  a  c  [0,1],  where  x  is  an  n-vector,  f^x)  (i  =  1,2)  is 
strictly  concave,-^  and  each  component  function  of  g(x)  =  (g^(x) , . . .  ,gm(x) ) 
is  concave.  Certain  additional  regularity  requirements  are  detailed  in 
subsection  2.1. 

Since  our  topic  is  parametric  programming,  rather  than  ordinary 
( non- parame trie)  mathematical  programming,  we  shall  further  assume 
that  an  optimal  solution  of  (Kz)  is  available  for  some  value  of  a 
in  the  unit  interval.  This  assumption  is  in  fact  not  restrictive, 
for  it  is  shown  in  subsection  1.1  that  a  parametric  programming  algorithm 
for  (Rz)  which  requires  an  optimal  solution  for  some  value  of  (Z 
in  order  t.o  "get  started"  can  itself  be  used  to  generate  such  an 
optimal  solution. 


The  algorithms  to  be  given  still  apply  if  (in  the  following,  e  >  0 
is  arbitrarily  small):  (a)  f^  is  strictly  concave  and  f '  is  (non- 

strictly)  concave  and  [0,l]  is  replaced  by  [e,l],  or  (b)  f^  is 
concave  and  f2  is  strictly  concave  and  [0,1]  is  replaced  by 
[0,1-e],  or  (c)  af^  +  (l-a)f2  is  strictly  concave  for  each  fixed 
a  e  (0,1)  and  [0,1]  is  replaced  by  [e,l-e]. 


] 


1 

i 


t 

A 


A 
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The  remainder  of  this  section  motivates  (K*)  and  the  present 
class  of  algorithms:  in  subsection  1.1  it  is  noted  that  (Fa)  subsumes 
the  vector  maximum  problem  for  two  criterion  functions  and  also  the 
standard  (non-parametric)  concave  programming  problem,  and  in  sub¬ 
section  1.2  the  Kuhn- Tucker  Theorem  for  nonlinear  programming  is 
presented  in  slightly  unconventional  form  so  as  to  display  clearly 
the  foundation  upon  which  the  present  class  of  algorithms  is  built. 

Section  2  is  devoted  to  presenting  and  proving  a  Basic  Conceptual 
Algorithm  for  solving  (Ra)  for  each  value  of  Ot  in  the  unit  interval. 
Three  graphical  examples  are  given  in  Appendix  B.  The  development 
of  this  conceptual  algorithm  into  a  Basic  Computational  Algorithm,  via  the 
use  of  Newton's  method  for  solving  the  relevant  systems  of  equations, 
is  the  subject  of  section  3-  Some  necessary  computational  devices  are 
recorded  in  Appendix  C.  Section  4  hosts  a  modification  (more  accurately, 
a  completion)  of  the  algorithms  aimed  at  improving  their  efficiency. 

Two  extensions  are  indicated  in  section  3:  the  adaptation  of  the 
present  algorithms  to  handle  linear  equality  constraints,  and  the 
possibility  of  solving  more  general  kinds  of  parametric  problems  than 

(Rx). 

1. 1  Motivation  of  (Fa) 

One  motive  for  studying  (FCt)  was  given  in  Chapter  II.  From 
Proposition  6  of  that  chapter,  which  applies  because  of  the  above 
assumptions,  solving  (Fa)  for  all  0  <  Ot  <  1  is  exactly  equivalent 
to  solving  the  vector  maximum  problem 

"Maximize"  f^(x),  fg(x)  subject  to  g(x)  >  0  . 


(1) 


That  is,  every  efficient  decision  for  (l)  is  an  optimal  solution  of 
(Kx)  for  some  0  <  a  <  1,  and  conversely. 

Another  reason  for  studying  (Rx)  is  that  it  subsumes  the  standard 
problem  of  concave  programming.  Suppose  that  it  is  desired  to  solve 

(2)  Maximize  F(x)  subject  to  g(x)  >  0  , 

X  ~  —  m  -■ 

where  F(x)  is  strictly  concave  and  the  constraint  functions  are  all 
concave.  If  x°  is  any  feasible  decision  whatsoever  of  (2),  put 
(Kx)  equal  to 

n  o  2 

Maximize  CXF(x)  +  (l-a)(-l)  £  (x^  -  x^) 
x  1 

(3a) 

subject  to  g(x)  >  0  . 

Then  x°  clearly  is  the  optimal  solution  of  (3o),  and  (3a)  satisfies 
the  assumptions  required  of  (Kx)  in  the  opening  paragraph.  Applying 
an  algorithm  for  parametric  concave  programming  to  (3a)  beginning 
with  a  =  0  and  increasing  a  until  a  =  1,  one  obtains  the  optimal 
solution  to  (3^)>  which  is  identical  to  (2).  Hence  a  parametric 
algorithm  for  (Rx)  provides  a  "deformation"  method  of  concave  pro¬ 
gramming. 

Problem  (3a)  is  capable  of  an  interesting  interpretation,  which 
we  shall  now  sketch  briefly.  Consider  an  enterprise  currently  "operating" 
at  the  (feasible)  point  x°,  with  a  single  criterion  function  F(x) 
and  a  feasible  operating  region  (x:  g(x)  >  0).  Due  to  conservatism, 
or  a  desire  to  avoid  disrupting  the  operations  of  the  enterprise 
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radically,  or  to  a  desire  i  hedge  against  the  risk  of  a  faulty  decision 
model,  assume  that  the  managers  of  the  enterprise  prefer  to  adjust  the 


operating  point  gradually  from  x°  toward  x*,  where  x*  is  optimal 

o  2 

in  (2).  If  the  managers  have  a  quadratic  loss  function  £  (x^-x^ 
associated  with  deviations  from  x°,  the  optimal  solution  to  (3a) 
as  a  varies  from  0  to  1  gives  an  optimum  path  from  x°  to  x*. 

Since  (Rat)  for  fixed  a  is  of  the  form  (2),  the  device  repre¬ 
sented  by  (3a)  can  be  used  to  find  a  starting  optimal  solution  to 
(Rj)  if  one  exists  (providing  that  a  feasible  decision  is  known),  so 
that  the  assumption  stated  in  the  introduction  is  not  restrictive, 
as  asserted. 

Of  course,  in  place  of  (3a)  one  could  use 
Maximize  aF(x)  +  (l-a)H(x) 

(te)  - 

subject  to  _g(x)  >  0  , 

where  H(x)  is  a  strictly  concave  function  with  a  known  maximum 
over  the  feasible  region. 

1, 2  Theoretical  Foundation 

The  standard  problem  of  concave  programming  can  be  written  in  the 

form  of  (Pa  )  with  a  fixed.  For  simplicity  of  notation,  we  write 
v  o  o 

f(x;a)  for  af^(x)  +  (l-a)f2(x)»  Hence  (R2q)  may  be  written  as 

( FOc  )  Maximize  f(x;a  )  subject  to  g(x)  >  0  . 

x 
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Fundamental  theoretical  results  concerning  this  problem  have  been  given 
by  Kuhn  and  Tucker  (1951).  A  version  of  their  Theorem  3  is  recorded 
here  without  proof. 


Theorem  ( Kuhn- Tucker ) l 

Consider  (B3  )  with  a  fixed.  Let  f(*x:a  )  and  g.  (x) 
o  o  —  o  i  — 

(i  »  l,...,m)  be  differentiable  on  the  feasible  region  {x:  g(x)  >  0), 
let  f(x;aQ)  be  concave  on  the  feasible  region,  and  let  gi(x) 

(i  =  l,...,m)  be  concave  on  En.  Assume  that  the  constraint  functions 
satisfy  the  Kuhn-Tucker  Constraint  Qualification  (see  the  remark 
following  the  statement  of  the  theorem). 

Then  x°  is  an  optimal  solution  of  (R*q)  if  and  only  if  there 
exist  real  m  numbers  such  that  (x°,\°)  satisfies  the  following 

(Kuhn-Tucker)  conditions-^  at  a  =  Cto: 


m 


(5) 


Vxf(x;a)  +  £  xiVxSi(x)  =  o 


(6) 

(7) 


gjOO  >  °  ,  i  =  1,  ...  ,  m 


implies 


i  -  1,  ...  ,  m  . 


Remark:  For  a  statement  and  discussion  of  the  Kuhn-Tucker  Constraint 
Qualification,  see  Kuhn  and  Tucker  (1951#  p.  ^83)  or  Arrow, 
Hurwicz,  and  Uzawa  (1961).  It  has  been  shown,  for  example, 
that  if  all  the  constraints  are  linear  then  this  qualification 


27 

The  symbol 

e-g-,  Vxf(x) 


V 


denotes  the  gradient  of  a  function  of  several  variables, 


-  df(g) 
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is  satisfied;  and  that  the  existence  of  an  interior  point 
of  the  feasible  region  is  also  sufficient  for  the  qualifi¬ 
cation  to  be  satisfied.  The  sufficient  condition  which  will 
be  of  direct  use  in  the  sequel  is:  if  x*(c*o)  is  an  optimal 
solution  of  (R*o),  then  the  matrix  whose  rows  are 
VA<x.<«o>>,  i  such  that  g^x^a  ))  -  is  of  maximal 
rank  (see  Arrow,  Hurwicz,  and  Uzawa,  1961). 

Direct  analytical  or  numerical  attempts  to  satisfy  these  conditions 
have  proven  quite  difficult,  in  general. 

We  shall  find  the  following  equivalent  version  of  the  Kuhn- Tucker 
Theorem  more  suitable  for  our  purposes. 

Theorem  (Kuhn- Tucker,  an  alternate  version) : 

Assume  that  the  hypotheses  of  the  Kuhn- Tucker  Theorem  are  satisfied. 

Then  x°  is  an  optimal  solution  of  (R2q)  if  and  only  if  there 
exist  m  real  numbers  u°  and  a  subset  5°  of  constraint  indices 
such  that  (x0,u°,S°)  satisfies  the  following  conditions  at  a  =  aQ: 

Vxf(x;a)  +  £  uiVxci^-'  =  - 

o 

g,(x)  =0,  V  i  €  S 

ui  =  0,  V  i  i  s 
g.(x)  >  0,  V  i  i  S 
u^  >  0,  V  i  e  S  . 


(=s)a 


(KT-l) 

(KT-2) 


(KT-3) 

(KT-4) 
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Equations  (KT-l)  (KT-l')  uppear  so  often  together  in  the  sequel 
that  we  introduce  the  special  synbol  (=s)a  to  denote  them  (in  this 
notation,  S  and  a  may  vury) .  Wo  also  denote  the  set  of  the  first  m 
positive  integers  by  M. 

The  equivalence  of  the  two  versions  of  this  theorem  follows  from 
the  easily  verified 

Proposition  1; 

(i)  If  (x°,\°)  satisfies  (5)  through  (7)  at  aQ,  then 

(x0,\°,S°)  satisfies  (KT-l)  through  (KT-4)  at  a  for 
o 

any  S  satisfying 

(8)  (i  €  M:  \°  >  0)  CS0^  (i  e  M:  gi(x°)  =  0)  . 

(ii)  If  (x°,u°,S0)  satisfies  (KT-l)  through  (KT-4)  at  aQ, 
then  (x°,u°)  satisfies  (5)  through  (7)  at  (Xq . 

The  numbers  \ ^  or  u^  will  be  referred  to  as  dual  variables. 

In  view  of  Proposition  1  it  is  useless  to  distinguish  between  \  and 
u;  henceforth  we  shall  use  the  symbol  u  to  refer  to  the  dual  vari¬ 
ables  of  either  version  of  the  Kuhn- Tucker  Theorem. 

The  concept  of  a  valid  set  plays  a  central  role  in  this  work. 

A  subset  S°  of  constraint  indices  is  said  to  be  valid  at  a  if 

-  o 

and  only  if  there  exists  (x°,u°)  such  that  (x°,u°,S°)  satisfies 
(KT-l)  through  (KT-4)  at  a  . 
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Proposition  2: 

A  subset  S°  of  constraint  indices  is  vaiid  at  a  if  and  only 

o 

if  S°  satisfies  (8)  for  some  (x°,\°)  which  satisfies  (5) 

through  (7)  at  a  . 

Proof:  Assume  that  S°  is  valid  at  a  .  Then  there  exists  (x°,u°) 
such  that  (x0,u°,S°)  satisfies  (KT-l)  through  (KT-4)  at  0tQ,  which 
implies  by  part  (ii)  of  Proposition  1  that  (x°,u°)  satisfies  (5) 
through  (7)  at  a  .  By  (KT-2)  and  (KT-'O,  (i  €  M:  \°  >  0)CS°  holds. 
By  (KT-2),  S°d  (i  e  M:  g,(x°)  =  0)  holds.  This  proves  necessity. 

Assume  now  that  S°  satisfies  (8)  for  some  (x°,\°)  satisfying  (5) 
through  (7)  at  a q.  By  part  (i)  of  Proposition  1,  (x°,\0,S°)  satisfies 
(KT-l)  through  (KT-4)  at  aQ,  which  shows  that  S°  is  valid  at  aQ. 

The  alternate  version  encourages  the  important  observation  that  the 
Kuhn- Tucker  Conditions  may  be  viewed  as  the  Lagrange  multiplier  equations^' 

— ^  The  method  of  Lagrange  multipliers  (see,  e.g. ,  Apostol,  1957  >  P*  155) 
gives  a  set  of  first  order  necessary  conditions  for  a  point  x°  to  be 
an  optimal  solution  of  the  problem 

Maximize  f(x)  subject  to  g.(x)  =0,  i  =  1,  ...  ,  m  . 
x 

Assume  that  f(x)  and  g^(x)  (i  =  ^...jin)  are  continuously  differen¬ 
tiable  on  some  open  region  containing  the  feasible  region,  and  that  the 
matrix  whose  rows  are  ^gi(x°),  i  =  l,...,m,  is  of  maximal  rank  (note 
that  this  last  assumption  implies  that  m  <  n,  where  n  is  the  dimension 
of  x).  If  x°  is  an  optimal  solution  of  the  above  problem,  then 
there  exist  m  real  numbers  K.  such  that  (x°,\°)  satisfies  the 
(Lagrange  multiplier)  equations: 

7xf(x)  +  S  \Vx8i(x)  =  0  and 

i 

gi(x)  =0,  i  =  1,  ...  ,  m  . 
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applied  to  a  subset  S  of  the  constraints,  augmented  by  the  inequations 
(KT-3)  and  (KT-4).  Attention  thereby  focuses  on  discovering  the 
identity  of  a  valid  set,  for  if  one  knew  a  valid  set  S*  then  in 
principle  one  could  solve  (=S*)aQ  for  all  solutions  (x',u')> 
among  which  at  least  one  would  satisfy  (KT-3)  and  (KT-4)  and  hence 
solve  (Rxq).  Indeed,  at  least  one  algorithm  (see  Theil  and  Van  de 
Panne,  i960,  and  also  Boot,  1961)  has  already  been  proposed  which  is 
essentially  aimed  at  determining  a  valid  set.  However,  this  approach 
is  probably  not  very  efficient  computationally,  for  although  it  reduces 
the  concave  programming  problem  to  one  of  solving  sets  of  simultaneous 
equations,  there  is  a  vast  number  of  candidate  sets  of  equations  to 
be  tried  when  a  valid  set  is  not  known.  It  seems  to  be  difficult,  even 
for  problems  of  modest  size,  to  know  how  to  order  the  trials  so  as  to 
keep  the  number  of  erroneous  trials  at  a  reasonable  level.  This 
combinatorial  difficulty  is  further  aggravated  by  the  numerical  burden 
of  actually  solving  (=S)aQ.  Thus  we  may  expect  the  customary  gradient 
methods  to  be  more  efficient  than  methods  based  on  the  "valid  set 
approach. " 

Let  us  turn  now  to  parametric  programming.  It  is  perhaps  surprising, 
in  view  of  the  immediately  preceding  comments,  that  here  methods  based 
on  the  "valid  set  approach"  seem  to  nave  the  advantage  over  gradient 
methods.  In  fact  the  parametric  programming  algorithms  (  cf.  section  5 
of  Chapter  II)  of  Markowitz  (1956),  Houthakker  (i960),  and  Zahl  (1964) 
each  may  be  viewed  as  maintaining  the  identity  of  a  valid  set  as  a 
parameter  is  varied. 
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Under  appropriate  assumptions  the  optimal  solution  x*(a)  of 
(Ftt)  and  the  associated  dual  variables  u*(a)  are  unique  and  con¬ 
tinuous.  This  fact,  coupled  with  the  observation  that  there  is  only 
a  finite  number  of  subsets  of  constraints,  suggests  that  if  S'  is 
valid  at  aQ,  say,  then  S'  is  likely  to  be  valid  in  some  interval 
including  aQ.  If  this  is  the  case,  then  one  may  derive  x*(a)  and 
u#(a)  in  that  interval  by  solving  (=S')a  parametrically,  and  (KT-3) 
and  (KT-4)  are  automatically  satisfied.  If  this  is  not  the  case, 
then  even  though  (=S')a  may  have  a  solution  near  ccq,  either  (KT-3) 
or  (KT-4)  will  be  violated,  and  it  is  necessary  to  find  a  new  valid 
set  before  being  able  to  proceed.  Because  of  continuity,  moreover, 
a  set  which  is  valid  near  aQ  will  usually  differ  by  only  a  few 
constraint  indices  from  S'.  This  approach  leads  to  a  decomposition  of 
( Rac)  on  [0,1]  into  a  chain  of  parametric  subproblems.  Each  sub¬ 
problem  involves  the  parametric  solution  of  the  Lagrange  multiplier 
equations  associated  with  the  constraints  specified  by  a  constant  valid 
set  on  a  subinterval  of  [0,1].  By  continuity  the  optimal  terminal 
solution  to  one  subproblem  is  the  optimal  initial  solution  to  the 
next  subproblem  of  the  chain,  and  the  valid  sets  of  adjacent  sub¬ 
problems  are  both  valid  at  the  transition  point  between  them. 

Thus  parametric  programming  can  be  reduced  essentially  to  the 
problem  in  numerical  analysis  of  solving  parameterized  (nonlinear, 
in  general)  simultaneous  equations.  This  approach  to  parametric 
programming  turns  out  to  be  a  useful  one  computationally,  since  the 
systems  of  equations  involved  will  be  shown  to  be  well-behaved.  By 
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applying  Newton's  method  (see  Appendix  C),  second  order  convergence 
can  be  achieved  as  the  parameter  increases  by  discrete  increments, 
whereas  gradient  methods  display  roughly  first  order  convergence. 

2.  A  Basic  Conceptual  Algorithm 

In  this  section  ve  state  and  prove  a  Basic  Conceptual  Algorithm 
for  solving  (Rx)  for  each  value  of  a  in  the  unit  interval.  We 
use  the  adjective  "conceptual"  because  computational  implementation 
is  not  considered  at  this  point  of  the  exposition.  The  Basic  Con¬ 
ceptual  Algorithm  can  be  modified  and  implemented  in  various  ways, 
as  will  be  indicated  in  sections  3  and  4,  thus  giving  rise  to  an  entire 
class  of  computational  algorithms. 

2. 1  Assumptions 

We  assume  that  an  optimal  solution  of  (Rx)  is  available  for  some 
value  of  a  in  the  unit  interval,  say  a  =  0  (in  view  of  the  dis¬ 
cussion  of  subsection  1.1,  this  assumption  is  not  restrictive). 

Throughout  this  work  the  following  conditions  will  be  imposed 
upon  (Rx).  We  denote  the  feasible  region  (x:  g(x)  >0}  by  X. 

Condition  1;  The  functions  f^(x)  (i  =  1,2)  and  g^(x) 

(i  =  l,...,m)  are  analytic  on  some  open  region 
containing  X,  and  the  constraint  functions  are 
Concave  on  En. 

Condition  2:  X  is  non-empty  and  bounded. 
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Condition  3: 


are 


4/  rn2 

The  hessian  matrices-  \ j  i'.(x)  (i  -  1,2) 

v  x  l  ““ 

negative  definite  for  all  x  e  X. 

Condition  U ;  If  e  [0,1]  and  x*(aQ)  is  an  optimal  solution 
of  (K*0)>  then  the  matrix  whose  rows  are  the 
gradients  SJ  g.  (x*(a  )),  i  such  that 
gi(x*(a  ))  =  o,  is  of  maximal  rank. 

A  function  f(x,,...,x  )  of  n  real  variables  is  said  to  be 
'1  n 

analytic  in  a  region  R  if  in  some  neighborhood  of  every  point  of  R 
the  function  is  the  sum  of  a  convergent  power  series  with  real  coeffi¬ 
cients.  The  class  of  all  analytic  functions  includes,  for  example, 
ail  polynomials,  and  seems  amply  wide  enough  to  include  nearly  any 
continuous  function  likely  to  be  encountered  in  applications. 

Conditions  1  and  2  imply,  by  A.  1  of  Appendix  A,  that  X  is 
convex  and  compact. 

Condition  3  implies,  by  A.3>  that  f,  and  f  are  strictly 

1  d 

concave  on  X.  This,  in  turn,  implies  by  A.k  that  f(x;a)  =  af^(x)  + 
(l-cOf^x)  is  strictly  concave  on  X  for  each  fixed  value  of 
a  e  [0,1].  In  the  presence  of  Conditions  1  and  2,  this  last  assertion 
remains  true  even  on  some  open  interval  containing  [0,1],  as 
Proposition  3  shows. 

Proposition  3* 

p 

Assume  that  Conditions  1,  2,  and  3  hold.  Then  V7  f(xja)  is 

I7~, - 

Vx  f(x)  denotes  the  n  by  n  matrix  whose  ij-th  element  is 

a2f(x) 

dx.dx. 

i  j 
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negative  definite  on  X  for  each  fixed  vrlue  of  a  in  some 
open  interval  containing  [0,1]. 

2 

Proof:  It  is  well-known  that  f(x;a)  is  negative  definite  at 

rs 

(x,a)  if  and  only  if  all  of  its  eigenvalues  iJTx  f(xja) )  (n  =  l,...,n) 

2 

are  negative,  i.e.,  if  Max  i  (U  f(xja))  <  0.  Assume  for  the  moment 

ji  p  v  x  — 

that  the  last-mentioned  function  is  continuous  in  (x,a)  on  some  open 
region  containing  X  x  [0,1],  where  x  denotes  the  Cartesian  product. 
Since  a  positive  sum  of  negative  definite  matrices  is  again  negative 
definite,  from  Condition  3  it  follows  that  Max  ft1((Vv  <  0 

U  X 

on  X  x  [0,1].  The  proposition  follows  from  this  fact,  the  assumed 
continuity,  and  the  compactness  of  X  x  [0,1]. 

To  see  that  Max  uV,  f(x;a))  is  continuous  on  some  open 
region  containing  X  x  [0,1],  observe  that  Condition  1  implies  that 
the  elements  of  y x  f(x;a)  are  all  continuous  on  some  open  region 
containing  X  x  [0,1].  Since  the  eigenvalues  of  a  square  matrix  are 
continuous  functions  of  its  elements  (Ostrowski,  i960,  p.  192), 

5  (\?2  f(x;cr))  (n  =  l,...,n)  is  therefore  continuous  on  some  open 
region  containing  X  x  [0,1];  the  same  must  be  true  for 
Max  tiS/l  f(x;a)). 

Remark:  As  indicated  in  Footnote  1  of  this  chapter,  Condition  3  may 
be  weakened  to  (in  the  following,  e  >  0  is  arbitrarily 
small):  (a)  f x ( x)  f2(x))  is  negative  (semi-) 

definite  for  all  x  e  X,  if  [0,1]  is  replaced  by  [e,l], 
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or  (t )  Vx  W  (Vx  ( x) )  is  negative  (semi-)  lefinitc 
for  all  x  e  X,  i  i'  [0,1  ]  is  replaced  by  [0,j~e],  or 

VO  pn  ) 

f  (x)  +  (1-a)  V  f,,(x)  is  negative  definite  for 
all  x  e  X  at  each  a  e  (0,1),  if  [ 0, 1 ]  is  replaced 

by  [  e,l-€  ]. 

Condition  4  is  equivalent  to  requiring  that  the  gradients 
Vx  E’(x*(a0))>  i  such  that  g^(x*(aQ))  =  0>  must  be  linearly 
independent;  hence  at  most  n  constraints  can  be  satisfied  with 
exact  equality  at  an  optimal  solution  of  (FO^).  the  remark 
following  the  Kuhn- Tucker  Theorem,  it  was  noted  that  this  condition 
implies  that  the  Kuhn-Tucker  Constraint  Qualification  holds.  Thus 
the  hypotheses  of  the  Kuhn-Tucker  Theorem  are  satisfied  by  (Kzq) 
for  each  fixed  aQ  e  [0,1]  when  Conditions  1,  3>  and  4  hold. 

2.2  Statement  of  the  Basic  Conceptual  Algorithm 

For  convenience  we  view  a  as  increasing  from  0  toward  1. 

Step  1:  Solve  (Po)  by  any  convenient  method,  so  that 

(x*(0),  u*(0),  S*)  satisfying  ^KT-l)  through  (KT-4) 
at  a  =  0  is  at  hand.  Put  a°  =0,  S°  =  S*,  and 
(x,u)°  =  (x*(0) ,  u*(o) ) . 

Step  2:  Solve  equations  (=S°)ct  by  any  convenient  method  as 

a  increases  above  a°  for  the  unique  continuous 
5/  S°  S° 

solution-'  (x  (a),  u  (a))  satisfying  the  left 

5  7  g  g 

Throughout  this  work  we  employ  the  symbol  (x  (a),  u  (a))  to 
denote  a  solution  of  equations  (=S)d. 
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end-point  value  (x,u)°  so  long  as  this  solution  satisfies 
(KT-3)  and  (KT-U);  that  is,  until  CK  =  a',  where 

a'  =  Max  {a:  a0  <  a  <  1,  g^x3  (a))  >  0,  V  i  it  S°, 

U1  (Q)  >  0,  V  i  €  S°  on  [a0,  a  ]}  . 

If  a'  =  1,  terminate.  Otherwise  put  j(x,u)0  = 

qO  qO 

(x  (a'),  u  (a1))  and  go  to  Step  3- 

Step  3?  Solve  equations  (-S)a  by  any  convenient  method  as 
a  increases  above  a'  for  the  unique  continuous 

s  s 

solution  (x  (a),  u  (a))  satisfying  the  left  end-point 
value  (x>u)°  for  different  sets  S  which  satisfy 

q°  qO 

(8.1)  (i  e  M:  u_^  (a')  >  0)C^sC3(i  e  M:  g^(x  (a'))  *  0} 

Q  *  O' 

untxl  for  some  S',  (x  (a),  u  (a))  satisfies  (KT-3) 
and  (KT-U)  on  [a',a'+e]  for  some  e  >  0.  Put 
a°  =  a',  S°  =  S',  and  return  to  Step  2. 

The  next  subsection  is  devoted  to  the  development  of  the  theo¬ 
retical  results  necessary  for  justifying  this  conceptual  algorithm. 
Complete  justification  requires  proof  of  the  following 

Theorem  (Basic): 

Assume  that  Conditions  1  through  b  hold.  Then  the  following 
assertions  regarding  the  Basic  Conceptual  Algorithm  hold: 
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(i)  Step  2  is  well-defined. 

S°  S° 

(ii)  At  each  execution  of  Step  2,  (x  (a),  u  (a) )  =  (x*(a), 
u*(a))  on  [a0, a'  ]. 

(iii)  Step  3  is  well-defined. 

(iv)  Step  3  will  be  executed  only  a  finite  number  of  times 
before  termination  obtains. 

2. 3  Theoretical  Development 

Continuity  plays  a  crucial  role  in  parametric  programming. 

Theorem  1  (Continuity)  : 

(i)  Assume  that  Conditions  1  through  3  hold.  Then  (Rx)  has 

a  unique  optimal  solution  x*(a),  and  x*(a)  is  continuous 
on  some  open  interval  containing  [0,1]. 

(ii)  Assume  that  Conditions  1  through  4  hold.  Then  ( R3c)  has 

unique  dual  variables  uf(at)  (i  =  l,...,m)  such  that 
(x*(d),  u*(a))  satisfies  the  Kuhn- Tucker  Conditions  (5) 
through  (7),  and  u*(a)  is  continuous,  on  some  open  interval 
containing  [0,1]. 

Proof :  First  we  prove  (i).  The  existence  of  an  optimal  solution 
of  (Rx)  for  any  fixed  value  of  a  follows  from  the  fact  that 
f(x;a)  is  a  continuous  function  of  x  on  the  compact  set  X.  The 

uniqueness  of  the  optimal  solution  follows  by  A. 2  from  the  fact  that 
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f(x;a)  is  strictly  concave  in  x  over  the  convex  set  X  for  each 
fixed  value  of  a  in  some  open  interval  containing  [0,1].  Denote 
the  unique  optimal  solution  by  x*(a) . 

To  demonstrate  that  x*(a)  is  continuous  on  ,  suppose 
the  contrary.  Then  there  exists  a  sequence  <  a  >  -*  a  with  a  , 
a  €  such  that  <  x*(aV)  >  -f  x*(a).  Hence  there  is  an  (open) 
neighborhood  N(x*(ac))  of  x*(a)  such  that  x*(aV)  i  N(x*(a)) 
infinitely  often,  and  by  taking  a  subsequence,  if  necessary,  we  may 
assume  that  this  holds  for  all  v.  Since^/  X-N(x*(a))  is  compact 
we  may  assume,  again  taking  a  subsequence  if  necessary,  that 
<  x*(av)  >  ■*  x '  €  [X-N(x*(a)) ).  Thus  by  the  continuity  of  f(x;a) 
with  respect  to  (x,a) ,  we  obtain 

(9)  <  f (x*(av) ;av)  >-  f(x'ia)  . 


Now  f(x*(a)  ;a)  =  Max  [f(xja)  subject  to 

x 

supremum  of  a  family  of  functions  linear  in  a, 


convex  in  a  on 


t£ 


Using  A.5>  we  obtain 


£(x)  >  0}  is  the 
emd  therefore  is 


(10)  <  f (x*(av)  ;av)  >  -*  f(x*(a);a)  . 

Assertions  (9)  and  (10)  imply  that  f(x'ja)  =  f(x*(a);a);  but  by 
construction  x'  /  x*(a),  so  that  the  unique  optimality  of  x*(a) 

— '  When  used  with  sets,  the  symbol  denotes  relative  complement. 
Thus  X-N(x*(a))  =  {x  e  X:  x  ft  N(x*(a))}. 


69 


is  violated.  Hence  x*('i)  must  be;  continuous  on  u  This  completes 
the  proof  of  (i). 


Now  we  prove  (ii).  The  existence  of  u*(ct)  such  that  (x*(a), 
u*(a) )  satisfies  (5)  through  (7)  on  some  open  interval  containing 
[0,1]  would  follow  from  the  necessity  of  the  Kuhn- Tucker  Conditions 
if  the  hypotheses  of  the  Kuhn- Tucker  Theorem  were  satisfied  by  (Rz) 
on  such  an  interval.  It  was  noted  in  subsection  2.1  that  these 
hypotheses  are  satisfied  for  each  value  of  a  e  [0,1].  To  show  that 
this  remains  true  on  some  open  interval  containing  [0,1],  in  view 
of  Condition  1,  Proposition  and  the  remark  following  the  statement 
of  the  Kuhn- Tucker  Theorem,  it  Is  enough  to  show  that  Condition  4  is 
still  satisfied  on  some  open  interval  containing  each  end-point. 
Consider  the  left  end-point  a  =  0.  Denote  by  D(a)  the  matrix  whose 
rows  are  \7xgi^-*^  ^  1  such  that  ^(**(0))  =  0.  By  Condition  4 

applied  at  a  =  0,  D(0)  has  rank  equal  to  the  number  of  its  rows, 

which  is  equivalent  to  the  existence  of  [D(o)D^(o)]  ,  which  is 

equivalent  to  the  determinantal  inequality  |d(0)d^(0)|  /  0.  Since 
|  D(ct)  D^(a)  |  is  a  continuous  function  of  a  for  QL  sufficiently 
near  0,  it  does  not  vanish  in  some  open  interval  containing  a  =  0, 
and  so  D(a)  remains  of  maximal  rank  on  such  an  interval.  This 
implies  that  Condition  4  holds  on  some  open  interval  containing  a  =  0, 
for  by  the  continuity  of  x*(a)  and  of  g^(x),  and  hence  of 
g^(x*(a)),  one  easily  obtains  that  [i:  g^(x*(a))  =  0 }CZ 

[i:  £^(x*(0))  =  0}  for  a  sufficiently  near  0.  A  similar  argu¬ 

ment  applies  to  a  =  1. 
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on  some 


To  show  the  uniqueness  and  continuity  of  u*(d) 
open  interval  containing  [0,1],  fix  aQ  e  [0,1].  Since  x*(a)  is 
unique,  from  (7)  we  conclude  that  u*(aQ)  must  vanish  for  each  i 
such  that  gi(x*(aQ) )  >0.  By  the  continuity  of  g^(x*(a)),  we 
have  that  g^x^a))  >  0  on  some  open  interval  about  aQ  when 
gi(x*(aQ) )  >  0.  Hence  u*(a)  vanishes  on  some  open  interval  about 
aQ  for  each  i  such  that  g^(x*(ato))  >  0.  Denote  [i:  g^(x*(aQ))  =  0) 
by  B.  It  remains  to  consider  uf(a),  ieB.  From  (5)  and  (7)  one 
obtains 

(11)  SJxr(x*(ao);ao)  +  £  u*(aQ)  Vxe± >  =  9.  • 

ieB 

Since  by  continuity  [i:  gi(x*(a))  =  0)0  (i:  (x-^Coc^) )  =  0)  =  B 

for  a  sufficiently  near  OtQ,  it  follows  from  (5)  and  (7)  that  (ll) 
must  hold  in  some  open  interval  about  aQ  with  the  same  summation  set. 
That  is, 

(12)  Vvf(x*(a);a)  +  Z  UT^  =  0 

holds  on  some  open  interval  about  aQ.  Write  u*(a)  for  the  row 
vector  whose  components  are  u*(a),  ieB.  Then  (12)  can  be  rewritten 
in  matrix  notation  as 

(12.1)  u*(a)D(a)  =  -  yxf(x*(a);a)  . 

Repeating  a  previous  argument,  one  may  assert  that  [ D(a)D^(a) 
exists  on  some  open  interval  containing  aQ.  Postmultiplying  (12.1) 
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by  D^a)  [  D(a)Dt(a)  ]’^,  one  obtains  that  u*(a)  must  satisfy-^ 

(12.2)  u*(a)  =  - 

on  some  open  interval  containing  aQ.  The  right-hand  side  is  unique 
and  continuous  in  a,  and  therefore  u*(ct)  is  also  unique  and  con- 

O 

tinuous  on  some  open  interval  containing  aQ. 

It  will  prove  convenient  to  introduce  some  special  notations. 

Define  Pa  to  be  the  set  of  constraint  indices  corresponding  to  the 
constraints  which  are  active  at  a  in  the  sense  that  their  dual 
variables  are  strictly  positi/e: 

Pa  =  (i  e  M:  u*(a)  >  0}  . 

Define  Ba  to  be  the  set  of  constraint  indices  corresponding  to  the 
constraints  which  are  binding  at  x*(a) : 

B3  =  (i  e  M:  g.(x*(a))  =  0}  . 

The  sets  Pa  and  Ba  are  well-defined  on  some  open  interval  con¬ 
taining  [0,1]  because  of  the  existence  and  uniqueness  of  (x*(a), 
u*(a))  on  some  such  an  interval.  We  can  now  state  two  important 
corollaries  of  Theorem  1. 

Corollary  1.1; 

Assume  that  Conditions  1  through  4  hold.  Then  for  each  0tQ  e  [0,1] 

— ■ '  Equation  (12.2)  is  intended  only  for  theoretical  and  not  compu¬ 
tational  use. 
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there  exists  an  open  interval  containing  such  that,  on 

this  interval, 


Pa  C  Pa  C  Ba  CBa  • 

o  —  —  —  o 

Proof:  The  outermost  relations  follow  directly  from  the  definitions 
of  Aa  and  Ba  and  the  continuity  of  x*(a)  and  u*(a).  The  middle 
relation  follows  from  (7). 

Corollary  1.2: 

Assume  that  Conditions  1  through  4  hold.  Then  there  is  an  open 
interval  containing  [0,1]  such  that,  for  each  fixed  value  of 
a  in  this  open  interval,  a  subset  S  of  constraint  indices  is 
valid  at  a  if  and  only  if  PaC IS  CBCt. 

Proof:  This  assertion  is  an  immediate  consequence  of  the  unique¬ 
ness  of  (x*(a),  u*(a))j  and  Proposition  2. 

The  significance  of  Corollaries  1.1  and  1.2  is  that  the  totality 

of  -lid  sets  at  a  e  [0,1]  contains  the  totality  of  valid  sets 

fc~  a  sufficiently  near  0tQ.  Hence  the  optimal  solution  of  (BaQ), 

which  yields  Pa^  and  BaQ,  gives  a  strong  indication  of  the  identity 

of  a  valid  set  for  a  near  a  . 

0 

The  next  theorem  shows  that  equations  (=S)a  can  be  solved  on 
some  open  interval  about  a  e  [0,1]  if  S  is  valid  at  aQ. 

Theorem  2: 

Let  a  e  [0,1]  be  fixed,  let  S  be  valid  at  a  ,  and  assume 
o  o 

Conditions  1  through  4  hold. 
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Then  there  exist  an  open  interval  iaQ  containing  and  symmetric 
about  and  an  open  neighborhood  N(x*(cio),  u*(aQ))  containing 

(x*(ao),  u*(aQ) ) ,  such  that  on  laQ  there  is  a  unique  function 
(xS(a),  uS(a))  in  N(x*(ao),  u#(aQ))  which  satisfies  (=S)a. 

s  s 

Furthermore,  (x  (a) ,  u  (a))  is  analytic  on  laQ. 

Proof:  The  theorem  would  follow  directly  from  a  version  of  the 
Implicit  Function  Theorem  (Bochner  and  Martin,  1948,  p.  39)  applied 
to  the  equations  (=S)d£  if  the  following  hypotheses  of  th<  t  theorem 
were  satisfied: 

(a)  (x*(aQ) ,  u*(ao))  satisfies  (  =  s)aQ. 

(b)  The  left-hand  side  of  each  equation  of  (=S)a  is  analytic 

in  (x,u,a)  in  an  open  neighborhood  of  (x*(aQ),  u*(aQ),ao). 
d((=S)a  ) 

(c)  The  Jacobian  —tj - i —  is  non-zero  at  (x*(a  ),  u*(a  )). 

“  O  “  o 

By  the  validity  of  S  at  a°,  part  (i)  of  Proposition  1  and  Corollary 

1.2,  (a)  holds.  It  follows  from  Condition  1  that  (b)  holds.  To 

simplify  the  task  of  showing  that  (c)  holds,  we  regroup  the  order  of 

partial  differentiation  ,  which  is  equivalent  to  regrouping  the  columns 

of  the  Jacobian  matrix,  so  that  we  actually  consider  the  Jacobian 
d((-S)a  ) 

- - Writing  H  for  the  n  by  n  hessian  matrix 

d(x;  u.,  ieS;  u^  i^S) 

Vx(f(-*(ao );ar}  Ui(0£o)  gi(**(ao)}J 

and  D  for  the  matrix  whose  rows  Eire  Vx*i  (x*(a  )),  i  e  S,  one 


readily  derives  that  this  Jacobian,  evaluated  at  (x*(a£Q),  u*(aQ)), 
is  the  determinant  of  the  matrix  (we  use  dotted  line  to  denote 
partition) 


H  j  D* 

D  T  0 

i 

0  1  0 

_ 1 _ 1 

1 

0  1  0 

1 

where  0  and  I  are  zero  and  identity  matrices  of  the  appropriate 
orderr..  The  determinant  is  non-zero  if  and  only  if 


is  invertible,  which  is  true  if  and  only  if  the  matrix  equation 


has  y  =  0,  z  =  0  as  its  only  solution,  where  y  is  an  n-vector 
and  z  is  a  vector  with  a  number  of  components  equal  to  the  number 
of  constraint  indices  in  S.  The  proof  of  the  theorem  will  be  com¬ 
plete  when  we  show  that  (13)  has  only  the  null  solution. 

Performing  the  indicated  block  multiplications  for  (13),  one 
obtains 


(13.1)  Hy  +  L'z  =  0  and 

(13.2)  Dy  =  0  . 
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Now  H  is  negative  definite,  for  it  is  a  positive  linear  combination 
of  negative  semidefinite  hessians,  at  least  one  of  which  is  known  to 
be  negative  definite.  Hence  H  is  invertible,  and  (13.1)  yields 

(13.3)  l  =  -H'Vz  . 

Premultiplying  (13*3)  by  D  and  using  (13.2),  one  obtains 

(13. b)  Dy  =  -DH“1Dtz  =  0.  . 

By  Corollary  1.2,  AO^CSQBQ^.  By  Condition  b,  therefore,  D 
is  of  maximal  rank,  and  that  rank  equals  the  number  of  rows  of  D. 
Hence  [DH'^D^]  is  invertible,  and  (13.M  yields  z  =  0.  By  ( 13- 3) > 
y  =  0  also.  Thus  (13)  has  only  the  null  solution. 

Corollary  2.1; 

Let  a  e  [0,1]  be  fixed,  let  S  be  valid  at  a  ,  and  assume 
o  o 

that  Conditions  1  through  b  hold. 

Then  there  exists  an  open  interval  containing  aQ  and  contained 
in  laQ  such  that,  for  each  fixed  value  of  oc  in  this  interval, 
the  following  three  assertions  are  equivalent: 

(i)  S  is  valid  at  a. 

(ii)  (xS(a) ,  uS(a) )  =  (x*(a) ,  u*(a))  . 

(iii)  gi(xs(a))  >0,  V  i  i  s 
u^(a)  >0,  Vies. 
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Proof:  (i)=>  (ii).  By  continuity,  (x*(ct) ,  u*(a))  e  N(x*(aQ), 
u*(aQ) )  for  all  a  sufficiently  near  a^i  by  the  validity  of  S 
at  a,  part  (i)  of  Proposition  1,  and  Corollary  1.2,  one  concludes 
that  (x*(a),  u*(a))  satisfies  (=S )ct}  since  the  solution  of 
(*S)a  is  unique  in  N(x*(aQ),  u*(aQ))  for  a  e  laQ,  assertion 
(ii)  follows. 

(ii) 3^  (iii).  Because  (x*(a) ,  u*(a))  satisfies  (5)  through 
(7),  (iii)  must  hold. 

C 

(iii) =>  (i).  Assertion  (iii)  and  the  fact  that  (x  (a), 

u  (a) )  satisfies  (=S)a  imply  by  the  definition  of  validity  that 
S  is  valid  at  a. 

One  more  result  must  be  established  before  a  complete  proof  of 
the  Basic  Theorem  can  be  given. 

Define  a  point  of  change  of  Bet  as  a  point  a'  with  the  pro¬ 
perty  that  there  is  no  open  interval  containing  a'  such  that 
Ba  =  Bot '  everywhere  on  that  interval.  A  similar  definition  holds 
for  a  point  of  change  of  Aa.  In  the  sequel,  the  phrase  "point  of 
change"  is  used  to  refer  to  either  a  point  of  change  of  Aoc  or  of 
Ba,  or  possibly  of  both. 

Theorem  3  (Finiteness): 

Assume  that  Conditions  1  through  4  hold.  Then  Ac*  and  BCt 
each  have  a  finite  number  of  points  of  change  on  [0,1]. 

Proof :  Suppose  that  Ba  has  a  finite  number  of  points  of 
change  on  [0,1].  Then  there  is  a  cluster  point  a  e  [0,1]  of 
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these  points  of  change.  Let  <  aV  >,  aV  e  [0,1],  be  a  sequence  of 
distinct  points  of  ge  of  Ba  which  converges  to  a.  Applying 
Corollary  1.1  at  aV,  we  see  that  there  exists  an  open  interval 
containing  Q£V  such  that  AaV^  Pa  O  B3  C1B2V  on  this  interval. 

By  the  definition  of  a  point  of  change  of  B2,  for  each  av  there 

v  /  v  1 

exists  a  number  B  contained  in  this  interval  and  in  (a  - 

aV  +  -)  such  that  A3VC  ABVC- BpV  d  BaV  (note  that  B£V  is  a 

proper  subset  of  Ba  ) .  Clearly  <  B  >  -*  a.  From  Corollary  1.1 

applied  at  a,  we  see  that  we  have  demonstrated  the  existence  of 

two  sequences  <  aV  >  -*  a,  <  >-*  a,  such  that  to  CAV  Cl 

A0VC:  BBVdBaVd  Ba  for  all  v  sufficiently  large.  Since  there 

.  in.  V  V 

is  but  a  finite  number  (2  )  of  possible  sets  which  BB  or  B3t 

could  possibly  be,  we  may  assume,  taking  a  subsequence  if  necessary, 

that  there  exist  sets  B'  and  B"  such  that  B£V  =  B"  CZ  B3V  =  B' 

for  all  v. 

B" 

Consider  the  function  x  (a)  defined  as  in  Theorem  2  applied 

at  a.  Since  B"  is  valid  at  cy  and  at  all  aV  and  £V,  v 

B" 

sufficiently  large,  x  (a)  =  x*(a)  at  these  points.  Take  i  e  B'-B". 
Then  g.  (xB  (aV))  =  0  and  g.  (x^  (BV))  >  0,  all  v  sufficiently 

1q  b"  -  1q  " 

large,  and  g.  (x  (a))  =  0.  In  other  words,  we  have  shown  that 
—  °  B" 

a  is  a  non-isolated  zero  of  g.  (x  (a)),  and  that  this  function  is 

o  __ 

not  identically  zero  on  any  open  interval  about  a.  But  this  leads 

to  a  contradiction  of  the  well-known  fact  (Apostol,  1957,  p-  5l8)  that 

the  zeros  of  an  analytic  function  which  is  not  identically  zero  are 

B" 

isolated,  for  by  Theorem  2  and  Condition  1  we  have  that  g.  (x  (a)) 

o 
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is  analytic  on  some  oj  en  interval  about  a.  Hence  the  supposition 
that  B3  has  an  infinite  number  of  points  of  change  on  [0,1]  is 
fal se. 

A  similar  argument  shows  that  P£X  cannot  have  an  infinite  number 
of  points  of  change  on  [0,1]. 


Applying  the  result  of  Theorem  3  to  a  given  ( Pdf) ,  define 

0  <  a'  <  ai,  <  * 1  ‘  <  1  to  be  the  collection  of  all  points  of 

change  of  Pa  or  B3  or  both.  As  a  matter  of  convention  we  take 

a'  =  0  and  a',  ,  =  1.  From  Corollaries  1.1  anc.  1.2  we  conclude  that 
o  N+l 

any  set  which  is  valid  at  a,  a'.  <  a  <  Of'  ,  is  also  valid  on  the 

0  J  i 

entire  closed  interval  [aj,  In  addition,  it  may  also  be 

valid  on  other  intervals,  of  course.  Among  the  sets  which  are  valid 


at  a',  there  are  all  those  which  are  valid  on  [a'  , ,  al  ]  or  on 
J  J-l  J 

[al  “j+i1. 

We  are  now  in  a  position  to  prove  the  Basic  Theorem. 


Proof  (Basic  Theorem):  First  we  prove  parts  (i)  and  (ii).  At 

the  beginning  of  each  Step  2,  (x*u)°  and  S°  satisfy  (KT-l) 

through  (KT-M  at  0£°,  so  that  S°  is  valid  at  a°  and  (x,u)°  = 

(x*(a°) ,  u*(a°)).  Let  J,  1  <  J  <  N+l  be  the  largest  integer  such 

that  S3  is  valid  on  [a°,  a']  (a'  =  ai  =  a°  =  0  is  permissible 

J  J  -L 

the  first  time  Step  2  is  executed).  Applying  Theorem  2  at  each  point 

of  [a°,  a'],  it  follows  that  (=S°)a  has  a  unique  analytic  solution 

(x  (a),  u°  (a))  satisfying  the  left  end-point  value  (x,u)  on  some 

interval  containing  [a°,  a’].  This  solution  satisfies  (KT-3)  and 

J 
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(KT-4)  and  equals  (x*(a),  u*(a))  on  [a0,  aj]  bv  Corollary  2.1. 
If  Ct'  =  1,  the  solution  of  (Ra)  on  [0,1]  is  complete.  If 

U 

S0  qO 

aj  <  1,  however,  (x  (a),  u  (a))  does  not  satisfy  (KT-3)  and 
(KT-4)  for  any  a  e  (dj,  aj+^) ,  for  otherwise  by  Corollary  2.1 
applied  at  a',  S°  would  be  valid  on  [a',  a'  .],  which  would 
violate  the  definition  of  J.  Clearly  the  scalar  a'  defined  in 
Step  2  is  precisely  a',  and  (i)  and  (ii)  hold. 

J 


Next  we  prove  (iii).  Any  set  S  which  satisfies  (8.1)  is  valid 

qO  qO 

at  a',  by  Corollary  1.2  and  the  fact  that  (x  (ct'),  u  (a'))  = 
(x*(a'),  u*(a')).  Applying  Theorem  2  at  a',  we  see  that  if  S 
satisfies  (8.1)  then  (=S)ct  has  a  solution  as  stated  on  [ct1,  ct'+e^] 
for  some  e ^  >  0.  By  Corollary  1.1  we  know  that  at  least  one  such 
S,  say  S',  is  valid  on  [a',  a'+e^]  for  some  0  <  by 

Corollary  2.1  applied  at  a',  (x^  (ct) ,  (a))  satisfies  (KT-3) 

and  (KT-4)  on  [a*,  Ct'+e]  for  some  0  <  e  <  Since  there  is  but 
a  finite  number  of  sets  satisfying  (8.1)  S'  will  be  found  after  a 
finite  number  of  trials. 

Finally,  we  prove  (iv).  It  was  established  in  the  proof  of  (i) 
that  Step  3  is  entered  each  time  a  point  of  change  Ct'  is  encountered 
at  Step  2  such  that  the  current  set  S°  being  used  at  Step  2  is  not 
valid  immediately  above  a'.  It  was  established  in  the  proof  of 
(iii)  that  Step  3  finds  a  set  which  is  valid  immediately  above  a' 


in  a  finite  number  of  trails,  and  control  is  returned  to  Step  2  along 
with  the  new  valid  set.  By  convention  we  have  taken  a  increasing, 
and  by  Theorem  3  there  is  but  a  finite  number  of  points  of  change  on 
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[0,1]:  it  follows  that  Step  5  will  only  have  to  be  executed  a  finite 
number  of  times  before  termination  obtains. 

Remark:  At  Step  2,  a'  need  not  be  the  next  point  of  change  aoove 

a°,  for  S°  may  remain  valid  on  an  interval  spanning  several 
points  of  change.  The  algorithm  could  be  modified  to  require 
S°  =  B3  at  Step  2,  so  that  a'  would  assume,  in  turn,  the 
values  of  each  point  of  change  of  B3;  or  one  could  require 
S°  =  kx  at  Step  2,  so  that  a1  would  assume,  in  turn,  the 
values  of  each  point  of  change  of  A3.  The  minimum  require¬ 
ment  (the  one  adopted  here)  is  A3CS°C1B3  at  Step  2,  and 
seems  more  symmetrical  and  less  arbitrary  than  either  of  the 
extreme  requirements  just  mentioned. 

From  the  proof  of  the  Basic  Theorem,  it  is  clear  that  the  Basic 
Conceptual  Algorithm  can  be  paraphrased  as  follows. 

Step  1:  By  any  convenient  method,  find  the  optimal  solution 
(x*(0),  u*(0))  of  (Po).  Set  3°  =  0,  S°  equal 
to  any  set  valid  at  a  =  0,  and  (*>u)°  =  (x*(0),  u*(0)). 

Step  2:  Solve  (=S°)a  as  a  increases  above  a°  for  its 

unique  continuous  solution  satisfying  the  left  end-point 
condition  (x^  (a°) ,  u^  (a°) )  =  (x,u)°,  namely 
(x*(a),  u*(a)) ,  until  either  a  =  1  or  a  point  of 
change  a'  of  kx  or  Ba  is  encountered  to  the  right 
of  which  S°  is  no  longer  valid.  In  the  first  case, 
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terminate;  in  the  second  case,  set  (x,u)°  =  (x*(a‘), 
u*(a'))  and  go  to  Step  3> 

Step  3s  Among  all  sets  valid  at  a',  find  one  which  is  valid  to 
the  right  of  a'.  Call  it  S'.  Set  a0  -  a',  S°  =  S', 
and  return  to  Step  2. 

See  Appendix  B  for  graphical  illustrations  of  this  algorithm. 

Now  that  the  Basic  Conceptual  Algorithm  has  been  theoretically- 
justified,  we  take  up  computational  considerations. 

3.  A  Basic  Computational  Algorithm 

In  order  to  implement  the  Basic  Conceptual  Algorithm,  it  is  necessary 
to  have  a  method  of  actually  solving  (=S)a  as  a  changes  parametric¬ 
ally  .  Only  in  certain  simple  cases  is  it  possible  or  economical  to 
solve  these  equations  analytically,  and  so  usually  numerical  methods 
must  be  used.  We  recommend  Newton's  method,  or  a  variation  thereof, 
as  an  efficient  means  of  solving  (=S)a  on  a  digital  computer  as  a 
changes  by  small  discrete  jumps. 

After  proving  the  applicability  of  Newton's  method,  we  state  and 
prove  a  Basic  Computational  Algorithm.  Some  necessary  computational 
refinements  are  then  briefly  indicated,  with  further  details  being 
added  in  Appendix  C. 

3. 1  Newton's  Method 

Newton's  method  is  briefly  reviewed  in  Appendix  C.  Under  Conditions 
1  through  4,  it  is  easily  seen  from  Theorem  C.l  of  Appendix  C  and  the 
proof  of  "Tieorem  2  that  for  each  aQ  e  [0,1],  Newton's  method  applied 
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to  (=C)aQ  is  well -define  l  and  quaurati cully  convergent  to  (n*(ao). 
u*(aQ))  if  S  is  valid  at  aQ  and  if  the  starting  point  (^>u)°  is 
in  a  sufficiently  small  neighborhood  of  (x*(aQ),  u*(aQ)).  Since 
(x*(ac) ,  u*(a) )  is  continuous,  by  taking  small  enough  (x*(ao-£Of) , 

u*(aQ-^a))  is  such  a  starting  point.  In  other  words,  Newton's  method 
is  applicable  point  by  point.  Does  there  exist  £a  >  0  such  that  a 
computational  algorithm  can  be  designed  using  Newton's  method  to  solve 
(=S)a  with  £a  as  a  fixed  step  size  throughout?  The  answer  is 
affirmative,  and  requires  a  proof  that  the  size  of  the  neighborhoods 
mentioned  above  may  be  taken  to  be  bounded  away  from  zero. 


Theorem  4. 1 « 

Let  Conditions  1  through  4  hold,  let  aQ  e  [0,1]  not  a  point  of 

change  be  fixed,  and  let  S  be  valid  at  OLq. 

Then  there  exists  a  scalar  r'  >  0,  which  does  not  depend  on 

otQ  or  on  S,  such  that  Newton's  method  applied  to  equations  (=S)aQ 
is  well-defined  and  quadratically  convergent  to  (x*(a£Q),  u*(aQ)) 
if  the  starting  po'rt  (x,u)°  is  in  the  (n+m  dimensional)  neighborhood 
Nr,(x*(ao),  u*(aQ)). 


Proof: 


1.  We  shall  use  the  notation  and  observations  immediately  following 

the  proof  of  Theorem  3*  To  prove  this  theorem  it  is  sufficient  to 

show  that  for  each  j  (j  =  0,...,N)  there  exists  a  scalar  r(j)  >  0 

such  that  the  following  assertions  hold  on  N^j)  (x*(oto) ,  u*(Oq)) 

for  any  fixed  a  e  [a!,  a'  ]  and  any  S  valid  on  [Of ' ,  a'  ]: 

o  j'  j+1  J  j  j+1 
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terminate;  in  the  second  case,  set  (x,u)°  =  (x*(a'), 
u*(a') )  and  go  to  Step  3- 

Step  3:  Among  all  sets  valid  at  a',  find  one  which  is  valid  to 
the  right  of  a'.  Call  it  S'.  Set  a0  =  a',  S°  *  S', 
and  return  to  Step  2. 

See  Appendix  B  for  graphical  illustrations  of  this  algorithm. 

Now  that  the  Basic  Conceptual  Algorithm  has  been  theoretically- 
justified,  we  take  up  computational  considerations. 

3.  A  Basic  Computational  Algorithm 

In  order  to  implement  the  Basic  Conceptual  Algorithm,  it  is  necessary 
to  have  a  method  of  actually  solving  (=S)a  as  a  changes  parametric¬ 
ally  .  Only  in  certain  simple  cases  is  it  possible  or  economical  to 
solve  these  equations  analytically,  and  so  usually  numerical  methods 
must  be  used.  We  recommend  Newton's  method,  or  a  variation  thereof, 
as  an  efficient  means  of  solving  (=S)a  on  a  digital  computer  as  a 
changes  by  small  discrete  jumps. 

After  proving  the  applicability  of  Newton's  method,  we  state  and 
prove  a  Basic  Computational  Algorithm.  Some  necessary  computational 
refinements  are  then  briefly  indicated,  with  further  details  being 
added  in  Appendix  C. 

3. 1  Newton's  Method 

Newton's  method  is  briefly  reviewed  in  Appendix  C.  Under  Conditions 
1  through  4,  it  is  easily  seen  from  Theorem  C.l  of  Appendix  C  and  the 
proof  of  Theorem  2  that  for  each  e  [0,1],  Newton's  method  applied 
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to  (=C)ao  is  well-dcf Ino  1  und  qunuruti cully  convergent  to  (::*(c/o), 
u*(aQ) )  if  S  Is  valid  at  aQ  and  If  the  starting  point  (x,u)°  is 
in  a  sufficiently  small  neighborhood  of  (x*(aQ) ,  u*(afQ)).  Since 
(x*(a),  u*(a))  is  continuous,  by  talcing  £&  small  enough  (x*(oto-£a) , 
u*(aQ-£a))  is  such  a  starting  point.  In  other  words,  Newton's  method 
is  applicable  point  by  point.  Does  there  exist  Act  >  0  such  that  a 
computational  algorithm  can  be  designed  using  Newton's  method  to  solve 
(=S)a  with  /5a  as  a  fixed  step  size  throughout?  The  answer  is 
affirmative,  and  requires  a  proof  that  the  size  of  the  neighborhoods 
mentioned  above  may  be  taken  to  be  bounded  away  from  zero. 


Theorem  h , 1 « 

Let  Conditions  1  through  4  hold,  let  aQ  e  [0,1]  not  a  point  of 

change  be  fixed,  and  let  S  be  valid  at  aQ. 

Then  there  exists  a  scalar  r'  >  0,  which  does  not  depend  on 

0£q  or  on  S,  such  that  Newton's  method  applied  to  equations  (=S)do 
is  well-defined  and  quadratically  convergent  to  (x*(aQ),  u*(a0)) 
if  the  starting  point  (x,u)°  is  in  the  (n+m  dimensional)  neighborhood 
Nr,(x*(aQ),  u*(aQ)). 


Proof : 

1.  We  shall  use  the  notation  and  observations  immediately  following 
the  proof  of  Theorem  3*  To  prove  this  theorem  it  is  sufficient  to 
show  that  for  each  j  (j  =  0,...,N)  there  exists  a  scalar  r(j)  >  0 
such  that  the  following  assertions  hold  on  Nr^  (x*(aQ) ,  u*(d£o)) 
for  any  fixed  aQ  €  [aj,  and  any  S  valid  on  [a^,  aj+^]: 
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is 


(a)  The  left-hand  side  of  each  equation  of  (  =  S)aQ 
twice  continuously  differentiable  with  respect  to 
(x,u) . 

d((=s)a  ) 

(b)  The  Jacobian  -rr - r —  t  0. 

d(x,u) 

(c)  A(x,uj  a  ,S)  <  L  <  1,  where  A(x,u;aQ,S)  is  a  certain 
upper  estimate  of  the  norm  of  the  Jacobian  matrix  of  the 
iteration  function  derived  by  applying  Newton's  method 
to  (=S)aQ  (see  section  1  of  Appendix  c) . 


To  see  why  this  plan  is  sufficient,  let  r'  =  Min{r(0) , . . . ,r(N) ) , 

let  a  e  [0,1]  not  a  point  of  change  be  fixed,  and  let  S  be  valid 
o 

at  a  .  Then  for  some  j  between  0  and  N  we  have  that  S  is 
o 

valid  on  [a',  a'  ]  and  a  e  [a',  a’  ].  Applying  Theorem  C.2  of 
j  j+1  o  j  J+1 

Appendix  C,  we  see  that  Newton's  method  applied  to  (=S)aQ  is  well- 

defined  and  quadratically  convergent  to  (x*(aQ),  u*(Qq))  if  the 

starting  point  (x,u)°  e  N  ,  (x*(aQ) ,  u*(ato)). 

2.  Let  j  be  fixed,  0  <  j  <  N,  let  a  e  [a!,  a'  ],  and 

let  S  be  any  set  which  is  valid  on  [a1.,  a']. 

t)  J 

By  Condition  1,  the  left-hand  side  of  each  equation  of  (=S)afQ 
is  twice  continuously  differentiable  with  respect  to  (x,u)  on  some 
open  neighborhood  of  (x*(aQ) ,  u*(aQ)). 

d((=s)a  ) 

The  Jacobian  — r-r - - —  /  0  at  (x*(a  ),  u*(a  ))  by  the  proof 

o(x,u)  -o-o 

of  Theorem  2.  As  a  consequence  of  Condition  1,  this  Jacobian  is  con¬ 
tinuous  with  respect  to  (x,u)  on  some  open  neighborhood  of  (x*(aQ), 
u*(aQ)) .  One  concludes  that  the  Jacobian  does  not  vanish  in  some  open 


neighborhood  of  (x*(aQ)  >  u*(aQ) )  • 
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It  can  be  shown  in  a  straightforward  manner  (see  Henrici,  196^ , 
p.  106)  that  A(x,u;  aQ,S)  vanishes  at  (x*(aQ) ,  u*(af^)).  By  Condition  1 
this  function  is  continuous  with  respect  to  (x,u)  on  some  open  neigh¬ 
borhood  of  (x*(ao),  u*(aQ) ) .  One  concludes  that  A(x,u;  Cto> S)  <  L, 
where  0  <  L  <  1,  on  some  open  neighborhood  about  (x*(aQ),  H*(a0))* 
Summarizing  this  part  of  the  proof,  we  assert  that  (a),  (b), 
and  (c)  hold  on  some  open  neighborhood  of  (x*(aQ),  u*(aQ))  when 
a  e  [a',  a'.  ,]  and  S  is  any  set  which  is  valid  on  fal,  a!  .  1. 

o  y  j+1  J  j’  j+1 

3.  Since  (x*(a) ,  u*(a))  is  continuous  on  the  compact  set 

[a'.,  a'],  the  image  set 
J  u  ^ 

T  =  {(x,u):  (x,u)  =  (x*(a)  ,u*(a) )  for  some  a,aj  <  a  <  a^+1] 

is  compact.  It  follows  from  the  compa  J  ness  of  T  and  the  result 
of  part  2  of  this  proof  that  there  exists  a  scalar  r(j)  >  0  such 


that  (a),  (b),  and  (c)  hold  on  Nr^^(x*(aQ),  u*(aQ))  when 
a  e  [a'.,  a\  .]  and  S  is  any  set  which  is  valid  on  [a',  a!  , 

o  j  j+i  y  j+1 


When 


Conditions  1  through  U  hold,  we  define  to  be  the 


minimum 


distance  between  any  two  points  of  change  on  [0,1],  and  l ^  to  be 

the  length  of  the  shortest  of  all  the  intervals  la  defined  in  Theorem  2 

o 

applied  at  every  point  of  change  on  [0,1]  with  each  set  which  is 
valid  at  each  point  of  change.  Define  i  =  -i  Minfi^,^}.  Note  that 

s  s 

(x  (a),  U  (a))  is  uniquely  defined,  by  Theorem  2  applied  at  a', 

J 

on  ia'.  =  [a'  -  i,  a:  +  1],  for  any  1  <  j  <  N  and  any  S  valid 
J  J  J 

at  a'. . 

J 


85 


Theorem  4 . 2  • 


Let  Conditions  1  through  4  hold,  let  a'  e  [ 0 , 1 J  be  a  partic¬ 
ular  point  of  change,  and  let  S  be  valid  at  a'. 

Then  there  exist  scalars  r"  >  0  and  0  <  i"  <  i,  which  do 
not  depend  on  a'  or  on  S,  such  that  Newton's  method  applied 
to  (=S)aQ  is  well-defined  and  quadratically  convergent  to 
(xV)  -  2S(%>)  if  aQ  e  [a'-i",  a'+i"]  and  if  the  starting  point 
(x,u)°  e  Nr„(xS(ao),  uS(aQ)). 

Proof: 

1.  Since  there  is  a  finite  number  of  points  of  change  jn  [0,1] 
and  a  finite  number  of  valid  sets  at  each,  it  is  sufficient  to  show 
that  the  theorem  holds  with  r  and  i  possibly  depending  on  a' 
and  S.  This  will  be  done  by  applying  Theorem  C.2  of  Appendix  C. 

2.  Let  a'  c  [0,1]  be  a  particular  point  of  change,  and  let 

S  be  valid  at  a'.  It  remains  to  demonstrate  the  existence  of  scalars 
r  >  0  and  0  <  i  <  T  such  that  the  following  three  assertions  hold 
on  Nr(x^(Q£Q),  uS(aQ))  when  e  [a'-i,  a'+i]: 

(a)  The  left-hand  side  of  each  equation  of  (=S)aQ  is 
twice  differentiable  with  respect  to  (x,u). 

a((=s)ao) 

(b)  The, Jacobian  -  ^  0. 

d(x>_u) 

(c)  A(x,u;  &0>S)  <  L  <  1. 

3-  In  view  of  the  fact  that  (x°(a'),  u°(a'))  =  (x*(a'),  u*(a')), 
we  may  argue  as  in  part  2  of  the  proof  of  Theorem  4.1  that  (a),  (b), 
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g 

and  (c)  hold  for  aQ  =  a'  on  some  open  neighborhood  of  (x  (a')> 
uC(a’)). 

s  s 

4.  Sinc^.  (x  (a) ,  u  (a))  is  continuous  on  the  closed  interval 

Ta' ,  and  therefore  uni f oral y  continuous,  one  may  assert  the  existence 

of  scalars  r  >  0  and  0  <  l  <  l  such  that  (a),  (b),  (c)  hold  on 

N  (xS(a  ),  uS(a  ))  when  a  e  [a'-i,  a '+£]. 
r  —  o  —  o  o 

By  specializing  Theorem  4.2  to  aQ  =  ot',  and  recalling  that 
(xS(cr') ,  uS(a'))  =  (x*(a')>  u*(cx'))  when  f.  is  valid  at  a',  it 
is  evident  that  Theorem  4.1  is  still  true  if  aQ  is  permitted  to  be 
a  point  of  change.  Since  (:.*(a),  u*(a))  is  continuous  on  [0,1], 
it  is  uniformly  continuous  on  [0,1],  and  one  immediately  obtains 
the  following  corollary  of  Theorem  4.1. 

Corollary  4.1; 

Let  Conditions  1  through  4  hold,  ^et  OiQ  e  [0,1],  and  let  S 

be  valid  at  a  . 

o 

Then  there  exists  a  scalar  6'  >  0,  which  does  not  depend  on 
ato  or  on  S,  such  that  Newtor's  method  applied  to  (=S)d!o  is 
weil-defined  and  quadratically  convergent  to  (x*(aQ),  u*(aQ)) 
if  the  starting  point  is  (x*(aQ-6),  u*(clq-&))  and  |&|  <  6', 

o  <  a  -6  <  l. 

—  o  - 

A  similar  argument  shows  that  Theorem  4.2  yields  the  following 
corollary. 
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Corollary  h,  2: 

Let  Conditions  1  through  4  hold,  let  a'  e  [0,1]  be  a  particular 
point  of  change,  and  let  S  be  valid  at  a'. 

Then  there  exist  scalars  6"  >  0  and  0  <£"<£,  which  do  not 
depend  on  a'  or  on  S,  such  that  Newton's  method  applied  to 
(=S)aQ  is  well-defined  and  quadratically  convergent  to 
(x3(aQ),  uS(ao))  if  aQ  e  [a'-i",  a'+i"]  and  if  (x*(a  -&), 
u*(a  -5))  is  the  starting  point  and  |&|  <  6",  0  <  CtQ-b  <  1. 


Using  the  results  of  the  previous  subsection,  we  can  design  a 

computational  counterpart  of  the  Basic  Conceptual  Algorithm  by  using 

Newton's  method  to  solve  (-S)a  as  a  increases  by  steps  of  size 

£Ot.  A  useful  idealization  is  obtained  by  assuming  that  there  is  no 

computational  error.  In  view  of  the  quadratic  nature  of  the  convergence 

of  Newton's  method,  it  is  no  less  plausible  to  assume  tnat  Newton's 

method  converges  to  an  exact  solution  of  (=S)o£  when  it  theoretically 

8/ 

should  converge.—'  An  annotated  flow  chart  of  the  Basic  Computational 
Algorithm  is  given  in  Figure  1. 


Theorem  8  • 

Assume  that  Conditions  1  through  4  hold,  that  there  is  no  compu¬ 
tational  error,  and  that  Newton's  method  converges  to  an  exact  solution 
of  (=S)d  when  it  theoretically  should  converge. 


This  assumption  is  strictly  true  only  when  f^  and  f  are  quadratic 
polynomials  and  all  constraints  are  linear,  in  which  case  (=S)a  is  a 
set  of  linear  equations  in  (x,u)  and  Newton's  method  therefore  leads 
to  an  exact  solution  in  a  single  iteration. 
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Then  thevc  exist  €  >  0  and  £a  >  0  such  that  the  Basic  Compu¬ 
tational  Algorithm  is  well-defined  and  will  terminate  with  =  1 

in  a  finite  number  of  computational  steps. 

Proof:  Put 

€,  =  i  Min  (u*(a' ) }  . 

0  1  <  j  <  N  J 

i  e  Aa' 

By  construction,  >  0.  By  the  uniform  continuity  of  u*(a) 

(i  *  l,...,m)  on  [0,1],  there  exists  a  scalar  6^  >  0  such  that 

|a-aj|  <  implies  |u*(a)-u*(ap  |  <  e1  (i  =  l,...,m)  for  any  J 
( j  =  1, . . .  ,N) .  Put 

e2  =  k  Min  g.(x*(a'))  . 

^  1  <  j  <  N  1  ~  J 

ilm] 

By  construction,  >  0.  By  the  uniform  continuity  of  g^(x*(a)) 

(i  =  l,...,m)  on  [0,1],  there  exists  a  scalar  5^  >  0  such  that 

la-CKjl  <  imPlies  I ei (x*(cr) )  -  g^x^aj) )  |  <  e2  (i  =  l,...,m) 
for  any  j  (j  =  1, . . .  ,N) . 

Put  e*  =  Min(e1,e2)  and  £a*  =  l/K,  where  K  is  the  smallest 
integer  satisfying  K  >  2/Min(5^ ,  In  view  of  the  Basic 

Theorem,  to  prove  this  theorem  it  is  sufficient  to  show  that  for  these 
choices  of  e  and  £&  Newton's  method  is  well-defined  and  sure  to 
be  convergent  as  stated  in  Steps  2  and  and  that  the  trials  ^  Step  3 
must  lead  to  a  success. 
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At  each  application  of  Newton's  method  during  Step  2, 

u^"1)  =  (x*(  (<J-l)2a)  ,  u*((j-l)to))  and  S°  is  valid  at 
Of  =  (J-l)2a.  If  S°  is  valid  at  J2a,  then  since  2a*  <  6'  we 
have  by  Corollary  4.1  that  Newton's  method  is  well-defined  and  con¬ 
vergent  to  (x*(J2a) ,  u*(j2a)).  If  S°  is  not  valid  at  J2a, 
then  since  &x*  <  l"  <  l  there  must  be  exactly  one  point  of  change 
a'  <  1  on  [  (j-l)2a,  J2a];  but  S°  is  valid  at  a',  2a*  <  i", 

and  2a*  <  5',  so  by  Corollary  4.2  Newton's  method  is  well-defined 

go  go 

and  convergent  to  (x  (J2a) ,  u  (J2a)),  and  Step  J  is  entered.  By 
the  choice  of  e*,  A  =  Aa'  and  B  =  Bdf'.  Corollary  4.2  again  applies, 
and  ensures  that  Newton's  method  is  well-defined  and  convergent  to 
(x  (J2a) ,  u  (J2a))  when  AC  3  QB.  The  trials  are  sure  to  lead  to 
a  success  because  some  set  which  is  valid  at  a'  must  also  be  valid 
at  J 2a,  since  a'  is  the  only  point  of  change  on  [ (j-l)2a,  J2a]. 

A  word  is  in  order  about  the  consequences  of  taking  e  and  2a 
different  from  e*  and  2o*.  This  is  of  considerable  practical 
importance,  since  e*  and  2a*  cannot  be  calculated  beforehand. 

It  is  possible  to  give  a  detailed  discussion  of  the  difficulties 
caused  in  the  Basic  Computational  Algorithm  by  "poor"  choices  of  e 
and  2a,  but  we  shall  limit  the  present  discussion  to  a  few  general 
remarks. 

It  is  clear  from  the  proof  of  the  theorem  that  when  e  =  e*,  any 
2a  <  2a*  will  do;  in  fact,  to  every  e,  0  <  €  <  e*,  there  exists 
2o*(e),  C  <  2o*(e)  <  2a*,  such  that  the  Basic  Computational  Algorithm 
is  well-defined  and  computationally  finite  when  e  and  2a  are  used 
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Step  3  Step  2  Step 


Solve  (Po).  Put  (x0,u°,S°)  equal  to  a 
solution  of  (KT-l)  through  (KT-M  at  a=0 


^  —f  J-l  J“l\  /  J 

Put  (x  ,u  ) = ( x  ,u  ) 

Put  J*~=  J  +  1 

Choose  step  size  Aa  >  0 
Choose  e  >  0 

Put  J  =  0 

No 

'  Is  jAa  >  1? 


Yes 

-►  Terminate 


A  „  ,  J-l  J-l,  . 

Iterate  from  (x  )  to 

(xJ,uJ),  the  solution*  of 

(=S°) JA  a,  by  Newton's  method 


(S*is  still  mlio  at  Jam) 


Write 

(x*(JAa)  ,u*(JA  a) ) 
=  (x  ,u  ) 


Is  g^x17)  >  0,  V  i  i  S°,  and  \  jj0 


u?  >  0,  Vie  S°? 


Put  A  =  {i:  u^"1  >  e} 
and  B  =  (i:  g^x*7”1)  <  e) 


(  $  13 

V*U  0 
AT  JdK) 


Put  S  =  S 


Choose  S  such  that  ACS(^B 
and  S  not  tried  before  at  the 
current  value  of  J 


Iterate  from  (x'7"'7,u'7”  )  to  (xJ U7),  the 
solution*  of  (=S  )JAa,  by  Newton's  method 


| _ Yes  I 

(Tw/S  ta IAL  W4S  ' 
mtktsttuL:  S  is 

V*L/0  *T  ) 


Is  gi(x  )  >  0,  V  i  fl  S  ,  and 
u^  >  0,  V  i  e  S  ? 


Figure  1 

Flow  Chart  of  the  Basic  Computational  Algorithm 


/(This  TAifU  WAS 

ivtcfstML  :  s  is  /y»r 
**<•*0  *7  Tc*) 


The  notation  used  here  is  contradictory  of  that  used  elsewhere 
J  J  go  go 

in  this  work:  (x  ,u  )  actually  means  (x  (jAa),u  (JAa))  at 

Step  2,  for  example. 
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and  .'<x  <  £a*(e) .  Thus  c  an  i  £a  need  not  bo  exactly  e*  and 
^a*  in  order  for  the  algorithm  to  be  applicable.  In  general,  however, 
the  following  qualitative  assertions  hold:  (a)  when  c  is  too  small, 
there  may  be  too  few  candidate  sets  at  Step  3>  i.e.,  there  may  be  no 

set  satisfying  ACS  QB  which  is  valid  at  J£a,  so  that  Step  3 
cannot  be  successfully  completed)  (b)  when  e  is  too  large,  there 
may  be  too  many  candidate  sets  at  Step  3>  resulting  in  an  excessive 
number  of  trials  before  Step  3  is  successfully  completed  and  possibly 
in  the  break-down  of  Newton's  method  (lack  of  convergence  or  lack  of 
existence  of  the  required  inverse  matrix)  for  the  trial  sets  which 
are  not  valid  at  and  do  not  satisfy  the  hypotheses  of  Corollary  4.2 

applied  at  the  point  of  change  just  before  J£a;  (c)  when  A2  is  too 
small,  the  algorithm  is  applicable  but  requires  more  executions  of 
Step  2  increments  in  a,  thereby  reducing  the  efficiency  of  the  algorithm 
for  a  usei  who  would  be  satisfied  with  knowing  (x*(a) ,  u*(a))  for  a 
coarser  grid  of  values;  and  (d)  when  £a  is  too  large,  Newton's  method 
is  apt  to  be  ill-defined,  or  divergent,  or  convergent  to  the  wrong 
solution  of  (=S)J£a,  and  it  could  happen  that  there  is  no  set  satis¬ 
fying  ACoCB  which  is  valid  at  J£a,  so  that  Step  3  cannot  be 
successfully  completed. 

It  is  evident  that  e  and  £a  must  be  selected  by  trial  and 
error.  A  more  powerful  approach  would  be  to  modify  e  and  £a  adaptively 
as  the  computations  proceed:  one  would  provide  for  monitoring  the  number 
of  iterations  used  by  Newton's  method  each  time  it  is  employed  and  also 
the  number  of  candidate  sets  at  Step  3,  and  the  basic  strategy  would 
be  to  increase  ixx  and/or  decrease  e  when  the  algorithm  is  making 
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good  progress  and  to  decrease  £a.  and/or  increase  e  when  the  algorithm 
encounters  difficulty.  Such  an  apnroach  was  applied  successfully  in  the 
design  of  the  machine  code  used  to  solve  the  parametric  problem  of 
Chapter  IV. 

In  addition  to  the  possibility  of  increasing  computational  effi¬ 
ciency  by  adaptive  selection  of  e  and  £a,  it  is  possible  to  greatly 
improve  computational  efficiency  by  using  refinement,  bordering,  and 
partitioning  methods  for  the  inverse  matrix  required  by  Newton's  method. 

A  discussion  of  some  of  these  devices  is  given  in  Appendix  C.  These 
devices,  or  others  like  them,  should  be  incorporated  into  any  machine 
code  for  implementing  the  present  algorithm  ,  or  the  number  of  matrix 
inversions  required  would  probably  preclude  the  use  of  Newton's  method. 

4 .  Further  Study  of  Step  3 

Step  3  of  the  Basic  Conceptual  Algorithm  involves  a  certain  amount 
of  trial  and  error:  at  the  point  of  change  a',  try  different  sets 
S  which  are  valid  at  Of'  (i.e.,  UX  '  CS  QB3')  until  one  is  found 
which  is  valid  to  the  right  of  a'.  When  B2'-A2'  is  a  singleton,  then 
no  erroneous  trials  will  be  made  at  Step  3;  for  there  are  only  two 
eligible  sets,  one  of  which  was  found  at  Step  2  not  to  be  valid  to  the 
right  of  a'.  When  B2'-A2'  contains  many  constraint  indices,  however, 
many  unsuccessful  trials  may  have  to  be  made  before  a  set  which  is  valid 
to  the  right  of  a'  is  found.  It  is  therefore  of  interest  to  appraise 
how  serious  a  difficulty  the  trial  and  error  nature  of  Step  3  is  likely 
to  be,  and  to  consider  some  ways  of  ameliorating  this  potential  stumbling 
block. 
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It  is  possible  to  argue  heuristically  that  B3'-A3',  which  may  be 
referred  to  as  the  set  of  degenerate  constraints  at  a',  will  ordinarily 
consist  of  only  one  constraint.  Let  a  e  [0,1]  be  fixed,  and  assume 
that  Conditions  1  through  4  hold.  From  the  sufficiency  of  the  Kuhn- 
Tucker  Theorem,  it  follows  that  x*(cto)  also  is  the  optimum  solution 
to  the  problem 

Maximize  f(x;a  )  subject  to  g.(x)  >0,  Vie  A3q  . 
x 

In  other  words,  all  constraints  except  those  of  A3q  are  redundant. 

The  fact  that  some  of  them,  namely  those  of  B3  -A3  ,  happen  to  be 

o  o 

exactly  satisfied  at  x*(aQ)  can  be  viewed  as  an  "accident."  It  seems 

more  likely  that  a  redundant  constraint  will  be  slack  at  x*(aQ) ,  as 

those  of  M- B3q  are.  If  a q  is  not  a  point  of  change,  we  conclude 

that  B3  -Aa  is  likely  to  be  empty  (Bat  -A3  =  0  implies  that  there 
o  o  o  o 

is  exactly  one  valid  set  at  a  )•  The  set  B3  -A3  is  sure  to  contain 
J  o  oo 

at  least  one  constraint,  however,  when  aQ  is  a  point  of  change,  for 
as  a  traverses  the  unit  interval  continuity  dictates  that  the  only 
way  a  constraint  can  make  the  transition  from  slack  to  active  or  con¬ 
versely  is  to  pass  through  B3-A3.  Unless  there  is  strong  interdependence 
between  different  constraints,  not  more  than  one  or  two  constraints  are 
likely  to  be  involved  in  such  a  transition  at  any  given  point  of  change. 

Remark:  The  last  observation  bringsup  an  interesting  point  regarding 

the  testing  of  new  mathematical  programming  algorithms.  Often 
a  new  algorithm  is  applied  to  a  number  of  problems  whose  data 
were  generated  "randomly"  in  an  effort  to  gain  computational 
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experience  quickly  and  to  judge  the  efficiency  of  the  algorithm. 
In  our  case  this  procedure  would  very  likely  lead  to  results 
biased  in  favor  of  our  algorithm.  The  reason,  of  course,  is 
that  "interdependence"  between  constraints  is  less  likely  to 
occur  when  problem  data  are  generated  randomly  than  when  problem 
data  derive  from  real  applications;  the  result  is  that  Step  3 
will  rarely  require  any  erroneous  trials  for  problems  with 
randomized  data. 

The  above  heuristic  argument,  although  somewhat  comforting,  does 
not  preclude  the  possibility  of  Ba' -Act'  being  quite  numerous  (by 
Condition  4,  B2  can  be  composed  of  at  most  n  constraint  indices, 
and  so  Ot'-Aa'  could  have  up  to  n  constraints).  Faced  with  this 
possibility,  one  may  follow  two  main  courses  of  inquiry.  One  may 
attempt  to  construct  methods  of  perturbing  (FOf)  so  as  to  ensure  that 
Ba-Aa  consists  of  only  one  or  two  constraints  at  each  point  of  change 
(see  Markowitz,  1956,  p.  125,  and  Zahl,  1964,  p.  156).  Alternatively, 
one  may  attempt  to  devise  rules  for  deciding  in  what  order  the  trials 
should  be  made  at  Step  3  (the  Basic  Conceptual  Algoritlur  is  ambiguous 
in  this  respect)  so  as  to  tend  to  keep  the  number  of  erroneous  trials 
small.  We  choose  to  follow  the  second  course  of  inquiry,  because 
(a)  this  type  of  investigation  is  conspicuously  lacking  at  present 
(for  a  notable  exception  in  the  context  of  a  related  problem  see  Theil 
and  Van  de  Panne,  i960),  and  (b)  the  second  course  of  inquiry  must  be 
undertaken  before  the  need  for  perturbation  can  be  established. 
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4 . 1  Preliminary  Remarks  on  Determining  the  Order  of  Trials  at  Step  3 
We  begin  by  establishing  some  terminology.  Suppose  that  Step  ? 
has  ended  with  the  point  of  change  a'  <  1.  Let  Ct *  +  be  a  point  between 
a’  and  the  next  largest  point  of  change.  If  S  is  valid  at  a'  but 
not  at  Qf'+,  the  unique  continuous  solution  of  (=S)a  satisfying  the 
left  end-point  value  (x*(a')j  u*(a'))  violates  either  (KT-3)  or 

(KT-4),  or  possibly  both,  as  a  increases  above  a'.  In  other  words, 

9/ 

S  "causes  an  alarm"  as  Ct  increases— /  above  a' .  A  violation  of 
(KT-3)  is  called  a  feasibility  alarm,  while  a  violation  of  (KT-4)  is 
called  an  optimality  alarm.  By  continuity,  the  set  of  feasibility  alarms 
must  be  contained  in  B2'-S,  and  the  set  of  optimality  alarms  must  be 
contained  in  the  set  S-A a';  hence  all  alarms  are  from  BCt'-Aa'.  Since 
S  is  not  valid  at  a'  +  ,  by  Corollary  1.2  either  {S-BQt'  +  }  /  0  or 
{Aa'+  -  S}  /  0.  The  set  S-Ba'+  will  be  called  the  excess  of  S  at 
a'+,  and  Aa'+  -  S  will  be  called  the  deficiency  of  S  at  a'  +  . 

Clearly  the  smallest  change  in  S  which  will  result  in  a  set  which 


is  valid  at  a'+  is  to  delete  its  excess  and  add  its  deficiency.  The 
number  of  constraint  indices  of  {Adt'+  -  S}  U  {S-BOf'  +  J  is  therefore 
a  measure  of  the  minimum  distance,— ^  which  we  denote  by  d(s),  between 
S  and  the  collection  of  all  sets  which  are  valid  at  a'  +  . 


— ‘ '  Since  x^(ct) and  uf(a) 
such  that  each  component  of 


are  analytic  functions,  there  is  an  e  >  0 

s  s 

(g(x  (a) ,u  (a))  has  constant  sign  on 


(a',a'+e).  It  is  in  this  sense  that  we  define  the  alarms  caused  by 


S  "as  Ct  increases  above  a'." 


— /  The  distance  between  a  set  C  and  a  set  D,  where  C  and  D  are 
both  subsets  of  M,  can  be  defined  as  the  number  of  elements  in  the  set 
{ C- D }  U  (D-C}.  It  is  readily  verified  that  this  d<  finition  meets  all  of 
the  usual  requirements  of  a  distance  metric  and  hence  makes  a  metric 
space  out  of  the  set  of  all  subsets  of  M. 
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Figure  2  is  designed  to  help  the  reader  visualize  the  various 
sets  mentioned  above  for  a  hypothetical  case,  and  it  will  be  convenient 
to  refer  to  it  occasionally  during  the  rest  of  this  section.  Each  dot 
represents  a  constraint--f ifteen  in  all.  The  constraints  in  S  are 
circled  to  distinguish  them  from  the  others.  Constraints  6,  8,  and 
10  are  labelled  "g"  to  signify  that  they  are  potential  feasibility 
alarms  (HX'-S),  and  constraints  7>  9>  and  11  are  labelled  "u"  to 
signify  that  they  are  potential  optimality  alarms  (S-ACf*)-  The 
deficiency  of  S  at  a'+  is  precisely  constraint  6,  and  the  excess 
is  constraint  11. 

Can  one  guess,  by  observing  which  feasibility  and  optimality 
alarms  S  causes  as  a  increases  above  a' ,  what  changes  can  be  made 
in  S  in  order  for  it  to  be  valid  at  a'+?  It  is  tempting  to  con¬ 
jecture  that  any  constraint  (in  S)  which  yields  an  optimality  alarm 
should  be  deleted  from  S,  for  it  is  well-known  (e.g.,  see  Wilde,  1962) 
that  a  dual  variable  may  be  interpreted  as  giving  the  marginal  decrease 
of  the  value  of  the  objective  function  with  respect  to  an  increase  in 
the  "right-hand  side"  of  the  corresponding  constraint.  Similarly,  it 
is  tempting  to  conjecture  that  any  constraint  (not  in  s)  which  yields 
a  feasibility  alarm  should  be  added  to  S  in  order  that  it  remain 
satisfied  as  a  increases  above  a'.  If  this  line  of  reasoning  were 
correct,  then  by  deleting  the  constraints  which  yield  optimality  alarms 
and  adding  those  which  yield  feasibility  alarms,  one  could  obtain  from 
S  a  set  which  is  valid  at  a'+;  for  the  optimality  alarms  would 
coincide  with  the  excess  of  S  and  the  feasibility  alarms  would 
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Figure 


coincide  with  the  deficiency  of  S.  Unfortunately  this  is  not  the  case, 
because  the  interactions  between  constraints  which  are  degenerate  at 
a'  have  been  ignored.  It  is  therefore  possible  to  construct  simple 
examples  (see  Appendix  B)  for  which  there  are  false  and  silent  alarms. 

By  a  false  alarm  we  mean  a  feasibility  alarm  which  is  not  from  the 
deficiency  of  S  at  a'  +  and  not  from  the  set  of  degenerate  constraints 
at  ac'+,  or  an  optimality  alarm  which  is  not  from  the  excess  of  S 
at  cr'+  and  not  from  the  set  of  degenerate  constraints  at  ct'+.  By 
a  silent  feasibility  alarm  we  mean  the  absence  of  a  feasibility  alarm 
from  a  constraint  in  the  deficiency  of  S  at  a'+,  and  by  a  silent 
optimality  alarm  we  refer  to  the  absence  of  an  optimality  alarm  from  a 
constraint  in  the  excess  of  S  at  Q£'+.  In  terms  of  Figure  2,  a 
false  feasibility  alarm  would  be  an  alarm  from  constraint  number  10,  a 
false  optimality  alarm  would  be  an  alarm  from  7>  s.  silent  feasibility 
alarm  would  be  the  absence  of  an  alarm  from  6,  and  a  silent  optimality 
alarm  would  be  the  absence  of  an  alarm  from  11.  Note  that  the  alarms 
from  the  set  of  constraints  which  are  degenerate  at  a'+(B3'+  -  Aa'+), 
if  any,  are  immaterial—  for  the  presence  or  absence  of  these  constraints 
(numbers  8  and  9  in  Figure  2)  for  a  trial  set  does  not  affect  its 
validity  at  a'+. 

The  above  remarks  indicate  that  not  very  much  information  about 
what  constitutes  a  valid  set  at  a'+  can  be  gleaned  from  a  trial  which 
fails  at  Step  Evidently  the  statement  of  Corollary  1.1  that 
A3' C  Ai'  +  CBa'+CBa'  is  about  as  strong  a  statement  as  can  be  made. 

As  has  already  been  pointed  out,  this  is  already  a  very  strong  statement 
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in  the  likely  event  that  there  are  only  a  few  degenerate  constraints  at 
a'.  Yet  when  u  trial  set  fails  at  Step  3  there  is  one  clue  to  the 
identity  of  a  set  which  is  valid  at  a'+  that  can  be  salvaged:  at 
least  one  of  the  alarms  given  during  a  failure  is  from  the  deficiency 
or  excess  at  a'  +  of  the  trial  set.  In  the  next  subsection  we  shall 
prove  this  fact.  The  result  will  then  be  used  to  devise  an  ordering 
of  trials  at  Step  3. 

4.2  Sharpening  Corollary  2. 1 

Lemma  6.1: 

Let  a'  t  [0,1]  be  a  point  of  change,  let  S  be  valid  at  a', 
and  assume  that  Conditions  i  through  4  hold. 

Then  there  exists  a  convex  set  X'DX  and  an  open  interval 
containing  and  symmetric  about  a'  and  contained  in  la'  such 

g 

that,  for  each  fixed  value  of  a  in  this  interval,  x  (a)  is 
the  optimal  solution  of 

Maximize  f(x;G) 
x  c  X' 

subject  to  g^(x)  =0,  V i  e  [S  -  S+a] 
g.(x)  >0,  Vie  S+a  , 

+  s 

where  S  a  C.U  e  S:  u^(a)  >  0). 

Proof:  Arguing  as  in  Proposition  3  and  using  the  continuity  of 

s  s 

u  (a)  and  the  fact  that  u  (a')  =  u*(a')  >0,  one  obtains  (here  we  employ 

2  ^  S 

the  notations  of  Proposition  3)  that  Max  t  (A  (f(x;a)  +£  u.(a)g,  (x))) 

f-i  X  .11“ 
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is  negative  on  X  x  at'  and  continuous  on  some  open  region  containing 
this  direct  product  set.  By  the  compactness  and  convexity  of  X  x  Of', 
it  follows  that  the  hessian  of  the  Lagrangian  function  f(x;a)  + 
m  S 

£  u^(a)  g,  (x)  is  negative  definite  on  some  open  convex  region 

i  1  i  “ 

X'  x  I'a'  containing  X  x  a'.  In  view  of  A.3>  the  Lagrangian  function 
must  be  strictly  concave  with  respect  to  x  on  the  open  convex  set 
X'  for  each  fixed  value  of  a  e  I'a'. 

Now  xS(a')  =  x*(a')  €  X  ,  y  open;  since  xS(a)  is  con- 

C 

tinuous  on  T  a1,  one  obtains  that  x  (a)  €  X'  for  all  a  sufficiently 
near  a' .  Since  the  gradient  with  respect  to  x  of  the  Lagrangian 

s  s 

function  vanishes  at  x  (a),  we  conclude  by  A. 6  that  x  (a)  is  the 
global  maxim  un  of  that  function  on  the  convex  set  X'  for  any  fixed 

C 

a  sufficiently  near  a'.  Using  the  fact  that  u^(a)  =  0,  V  i  i  S, 

C 

and  g^x  (a))  =  0,  V  i  e  S.  one  obtains,  for  any  fixed  a  suffi¬ 
ciently  near  a' ,  that 

Q  ^  G 

(lM  f(xb(a);  a)  >  f(x;a)  +£  ub(a)  g  (x),  V  x  e  X'  . 

1 

m  s  + 

Since  £  u.(a)  g.(x)  >  0  for  all  x  such  that  g.  (x)  =  0,  Vie  (S-S  a), 

1 

and  g^(x)  >  0,  V  i  €  S  a,  where  S  a  ^(i  e  S:  u^(a)  >  0},  the 
conclusion  of  the  lemma  follows  from  (l4). 

Remark:  An  easy  proof  of  this  lemma  can  be  constructed  from  the  Kuhn- 
Tucker  Theorem  when  all  constraints  are  linear;  in  this  case 
X'  may  be  taken  to  be  En.  When  all  constraints  are  linear, 
specialization  of  the  Kuhn- Tucker  Theorem  reveals  that  (=S)a 
are  necessary  and  sufficient  conditions  for  a  maximum  of  f(x>a) 
subject  to  g^(x)  =0,  V  i  e  S. 
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Remark:  The  region  X'  may  be  taken  to  be  contained  in  the  open  region 


mentioned  in  Condition  1. 


Theorem  6  • 

Let  a'  c  [0,1]  be  a  point  of  change,  let  S  be  valid  at  a', 
and  assume  that  Conditions  1  through  k  hold. 

Then  there  exists  an  open  interval  containing  and  symmetric  about 
a'  and  contained  in  la'  such  that,  for  each  fixed  value  of  a 
in  this  interval,  the  following  three  assertions  are  equivalent: 

(i)  S  is  valid  at  a. 

(ii)  (xs (a),  uS(a) )  -  (x*(a) ,  u*(a) ) . 

(iii)  g1(xs(a))  >0,  V  i  €  (Aa-S) 
u®(a)  >o,  v  i  €  (S-B2). 


Proof:  The  equivalence  of  (i)  and  (ii)  and  the  fact  that  (ii) 
implies  (iii)  are  known  from  Corollary  2.1.  To  complete  the  proof  of 
the  theorem,  it  is  sufficient  to  show  that  (iii)  implies  (ii)  on  the 
interval  mentioned  in  Lemma  6.1. 

Assume  that  (iii)  holds  for  same  fixed  value  of  a  in  the  interval 

g 

mentioned  in  Lemma  6.1.  Using  the  assumption  that  u^(a)  >  0, 

Vie  (S-Ba),  and  applying  Lemma  6.1  with  S+a  =  (S-Ba),  one  may 
assert  the  existence  of  a  convex  set  X'3X  such  that  x  (a)  is  an 
optimal  solution  of 


(15) 


Maximize  f(x;a)  subject  to  g  (x)  =  0,  V  i  e  (BaHs) 
x  e  X' 

gA(x)  >0,  Vic  (S-Ba)  . 
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g 

Using  the  assumption  that  (x  (a))  >  0,  Vie  (Aa-S),  we  have 
that  x°(a)  is  feasible  in 

Maximize  f(x;a) 
x  e  X' 

subject  to  gi(x)  =  0,  Vie  {B3  fl  S) 

gi(x)  >0,  Vie  (S-Bb)U  (Aa-S)  . 

Since  the  feasible  region  of  (l6)  is  included  in  that  of  (15), 

C 

x  (a)  must  be  an  optimal  solution  of  (16). 

It  follows  from  A.  4  and  A.  6  and  the  fact  that  (x*(a) ,  u*(a)) 
satisfies  (=Aa)a  that  x*(a)  is  optimal  in 

(17)  Maximize  f(x;a)  subject  to  g  (x)  >0,  V  i  €  Aa  . 

x  e  X'  1 

Since  the  feasible  region  of  (16)  is  included  in  that  of  ( 17) ,  and 
since  x*(ct)  is  feasible  in  (l6),  x*(a)  must  be  optimal  in  (16). 

That  is,  both  x*(a)  and  x  (a)  are  optimal  in  (l6);  thus 

s  s 

f(x*(a)}Ci)  =  f(x  (a)  ;a) .  Because  x  (a)  is  feasible  in  (17),  therefore, 

g 

we  finally  have  that  x  (a)  is  optimal  in  (17)»  Since  (17)  must  have 

g  * 

a  unique  optimal  solution  by  A.  2,  x  (a)  =  x*(a) .  This  implies,  by 

g 

Condition  4,  that  u  (a)  =  u*(a) .  Thus  (ii)  holds. 

The  significance  of  this  sharpening  of  Corollary  2.1  is  that 
it  rules  out  the  possibility  that  all  alarms  are  either  false  or  from 
the  set  of  degenerate  constraints  at  a’+  when  S  is  not  valid  at 
a'+.  That  is,  at  least  one  alarm  is  from  the  deficiency  or  excess 
of  S  at  Qf'  +  . 
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4 . 3  Modification  of  Step  ^--Determining  the  Order  of  Trials 

Suppose  that  Step  2  has  ended  with  th^  point  of  change  Qt'  <  1. 
Designate  the  set  of  alarms  which  are  given  by  S°  (the  set  used 
during  Step  2)  as  a  increases  above  a'  by  T.  Applying  Theorem  6 
at  a',  we  know  that  at  least  ont  of  the  alarms  is  from  the  excess 
or  deficiency  of  S°  at  a'+.  Unfortunately,  we  do  not  know  which 
one.  A  logical  way  of  proceeding  at  Step  3  is  to  modify  S°  by  one 
constraint  at  a  time  for  each  constraint  in  T,  i.e.,  try  the  sets 
S°  ♦  i  for  each  i  c  T,  where  the  symbol  S°  ♦  i  means  S°  U  i 
if  i  i  S°  and  S°-i  if  i  e  S°.  This  notation  is  designed  to 
avoid  having  to  distinguish  between  feasibility  and  optimality  alarms. 

In  other  words,  add  the  constraints  which  were  feasibility  alarms  to 
S°  and  delete  constraints  which  were  optimality  alarms  from  S°  one 
at  a  time  until  each  alarm  has  been  heeded  individually.  Note  that 
S°  +  i,  i  e  T,  is  valid  at  a'  since  all  alarms  caused  by  a  set 
which  is  valid  at  a'  must  be  from  BDJ'-Aa'.  Hence  S°  +  i,  i  e  T, 
satisfies  (8. l) . 

When  T  has  been  exhausted  by  this  first  generation  of  trials, 

at  least  one  trial  set,  say  S°  +  i  ,  is  one  unit  of  distance  closer 

—  o 

to  a  valid  set  at  Qt'+.  If  d(S°)  =  1  then  S°  +  i  is  valid  at 

-  o 

a'+  and  Step  3  has  been  successfully  completed.  If  d(S°)  >  1  then 
d(S°  +  i  )  =  d(S°)-l  >  0,  and  a  second  generation  of  trials  is 
necessary.  At  each  first  generation  trial,  let  denote  the 

alarms  due  to  S°  +  i,  i  e  T.  At  the  second  generation  one  should 
try  S°  +  i  +  j  for  all  i  e  T  and  all  j  e  T^.  The  symbol  S°  +  i  +  j 
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means  {S°  +  i)U  J  if  J^S°+i  and{S°  +  i}-j  if  j€S°+i.  Applying 
Theorem  6  at  a'  with  S  =  S°  +  iQ,  we  see  that  at  least  one  of 
the  alarms  due  to  S°  +  i  is  from  the  excess  or  deficiency  of 

S°  ♦  i  at  a'+,  but  we  do  not  know  which  one.  Hence  at  least  one 

-  o 

of  the  sets  S°  +  i  +  J,  j  €  T.  ,  is  one  unit  of  distance  closer  to 

"  0 

a  set  which  is  valid  at  a'+.  Designate  one  such  set  by  S  +  i  ♦  J  . 

—  o  —  o 

If  d(S°)  ■  2  then  S°  +  iQ  +  is  valid  at  a'+,  and  Step  3  hat 
been  successfully  completed.  If  d(S°)  >  2,  then  d(S°  +  i  +  Jq)  » 
d(S°)-2  >  0,  and  a  third  generation  of  trials  is  necessary. 

The  third  generation  of  trials  is  constructed  in  a  manner  analogous 
to  the  preceding  generations,  and  so  on  for  the  higher  order  generations. 
If  at  any  trial  a  set  is  encountered  which  has  been  tried  before,  it 
may,  of  course,  be  discarded. 

At  each  generation  the  distance  from  some  trial  set,  and  perhaps 
several,  to  the  collection  of  all  sets  which  are  valid  at  a'  +  is 
decreased  by  one  unit.  Since  d(S°)  is  finite  (in  fact  it  is  bounded 
by  the  number  of  constraints  in  Ba'-Aa'  minus  the  number  of  constraints 
in  Ba'+  -  kx'+),  after  a  finite  number  of  generations  of  trials  a 
set  which  is  valid  at  a'+  will  be  obtair.ed--after  exactly  d(S°) 
generations,  in  fact.  The  nearest  valid  set  is,  it  will  be  recalled, 

S°  plus  its  deficiency  at  a'+  minus  its  excess  at  a'+.  These  rules 
are  summarized  below. 

Order  of  Trials  at  Step  3 

1.  Let  T  denote  the  alarms  which  are  given  by  S°  as  dt 
increases  above  a'.  At  the  first  generation  of  trials. 
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try  S°  +  i  for  each  i  e  T.  Let  denote  the  set  of 

alarms  which  are  given  by  S°  +  i,  i  e  T,  as  Cl  increases 

above  a'.  If  =  0  for  some  i*  e  T,  then  S°  +  i* 

is  valid  at  d'+,  and  Step  3  has  been  completed}  otherwise, 
go  on  to  the  second  generation  of  trials. 

2.  At  the  second  generation  of  trials,  try  S°  ♦  i  +  J  for 

each  i  c  T  and  all  j  c  T^.  Let  be  the  set  of  alarms 

which  are  given  by  S°  +  i  +  j ,  icT  and  j  c  T^  as  a 
increases  above  a'  .  If  ■  0  for  some  i*  c  T  and 

j*  c  Ti#,  then  S°  +  i*  +  j*  is  valid  at  a'+,  and  Step  3 

has  been  completed;  otherwise,  go  on  t^a  third  generation 
of  trials. 

Etc.  (Omit  any  sets  which  have  been  tried  previously.) 

Since  the  only  modification  of  Step  3  being  suggested  here  is  a 
more  complete  specification  of  the  order  in  which  the  trial  sets  are 
to  be  considered,  and  since  this  order  has  been  shown  to  lead  to  a 
successful  completion  of  Step  3>  the  assertions  of  the  Basic  Theorem 
still  apply  to  the  Basic  Conceptual  Algorithm  with  Step  3  modified  as 
above. 

If  these  rules  are  to  be  incorporated  into  the  Basic  Computational 
Algorithm,  -hen  in  order  to  ensure  that  Theorem  6 -and  hence  the  above 
rules r- applies,  it  is  necessary  to  take  £a  less  than  one-half  the 
length  of  the  smallest  of  the  intervals  of  Theorem  6  applied  at  each 
point  of  change. 
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We  do  not  hold  that  the  order  of  trials  suggested  here  is  the  most 
efficient  order  which  can-  be  devised.  However,  the  following  advantages 
are  to  be  noted: 

(1)  Each  unsuccessful  trial  helps  to  determine  the  order  of 
successive  trials. 

(2)  The  suggested  order  of  trials  always  leads  to  the  (unique) 
valid  set  nearest  S°. 

(3)  A  valid  set  is  found  after  exactly  d(S°)  generations  of 
trials.  In  this  sense  search  termination  is  predictable, 
although  not  a  priori  so. 

(4)  S°  is  deformed  one  constraint  at  a  time  from  trial  to 
trial,  so  that  the  computational  machinery  is  upset  the 
least  amount  possible. 

5.  Some  Extensions 

5.1  Linear  Equality  Constraints 

Let  the  constraints  of  (Kz)  include  some  linear  equality 
constraints.  It  is  clear  that  if  each  such  constraint  is  written  as 
a  pair  of  inequality  constraints  (i.e.,  if  the  pair  g^(x)  >  0, 

-gi(x)  >0  is  written  in  place  of  g^(x)  =  0) ,  then  Condition  k  never 
holds.  Fortunately,  it  can  be  shown  that  a  simple  modification  of 
the  Basic  Conceptual  Algorithm  obviates  this  difficulty:  always  include 
the  linear  equality  constraints  in  S°  at  Step  2  and  in  the  trial 
sets  at  Step  3  (ignore  any  optimality  alarms  that  such  constraints  may 
give).  If  all  of  the  constraints  happen  to  be  linear  equalities,  in 
fact,  Step  3  would  disappear  entirely. 
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5.2  More  General  Parametric  Problems 


With  appropriate  modifications  of  the  four  conditions,  it  can  be 
shown  (Geoffrion,  19^5)  that  many  of  the  results  of  this  chapter  apply 
to  any  one-dimensional  perturbation  of 

• 

(1^)  Maximize  f(x,^)  subject  to  g(x,2)  >  0  > 

x  -  =  - 

where  the  parameter  2  =  (Pq_»  •  •  •  varies  over  a  convex  set  P  in 

r,  f(x,£)  is  continuous  in  (x,2)  and  strictly  concave  in  x  for 
each  2  €  6111(1  g^x^)  (i  -*  l,...,m)  is  concave  in  (x,  £).  By 

a  one-dimensional  perturbation  of  (P2)  we  mean  a  parametric  problem 
of  the  form 


Maximize  f(x,p'  +  aKp"  -  p ’ ) ) 
x 

subject  to  g(x,p'  +  a(p"  -  p'))  >0 

for  each  value  of  a  e  [0,1],  where  p',  p"  e  P. 

It  is  evident  that  (Pp)  is  general  enough  to  include  many  of 
the  parametric  problems  of  interest  to  those  who  wish  to  perform 
sensitivity  analysis  on  concave  programming  problems. 


CHAPTER  IV 


An  Illustrative  Example 

A  simple  model  of  a  firm  will  be  used  to  illustrate  the  manipu¬ 
lation  and  solution  of  a  decision  problem  under  uncertainty  by  means 
of  the  techniques  presented  in  the  preceding  three  chapters. 

1.  A  Decision  Problem  Under  Uncertainty 

Consider  a  hypothetical  firm  which  produces  and  sells  n  products 
in  an  imperfectly  competitive  market.  Assume  that  the  cost  of  producing 
and  selling  each  unit  of  product  i  is  c^  dollars  per  unit,  and 
that  the  total  dollar  revenue  accruing  from  the  sale  of  units  of 
product  i  is  r^x^  =  (a^b^P-d^x^^  ♦  (d^k, ) in^x.+l) ,  where 
a^,  d^,  k^  are  positive  scalars,  in(-)  denotes  the  natural  log, 
and  £  is  a  price  index.  The  interpretation  of  r^x^)  becomes  clearer 
if  one  examines  dr.(x.)/dx.  =  a  +b.f3-d,+d./(k.x.  +l) .  Since 
dr^Oj/dx^  =  a^+K0  and  dr^(°°)/dx^  =  a^+b^P-d^,  we  see  that  price 
gradually  decreases  from  a^+b^P  (notice  the  linear  dependence  on 
the  price  index)  to  a^+b^P-d^  dollars  per  unit  as  production  increases 
without  bound.  The  value  of  k^  determines  the  rapidity  of  the  price 
decrease,  and  it  is  easily  shown  that  a  proportion  0  <  t  <  1  of  the 
total  possible  price  decrease  d^  is  achieved  at  x^  =  t/(l-t)k^. 

If  we  denote  the  (short-run)  resource  and  other  constraints 
(including  x  >  0)  by  g(x)  >  0,  then  assuming  that  the  firm  can 
sell  all  it  produces  the  profit  maximization  problem  is 

n 

Maximize  £  +  b.p  -  di)xi  +  (d^k.  )/n(kix.  +  l)  -  c^ 

(i)  i  1=1 

subject  to  g(x)  >  0  . 


109 


We  shall  assume  that  all  functions  and  coefficients  are  known  except 
the  price  index  £,  which  will  be  regarded  as  a  random  variable  with 
a  known  cumulative  distribution  function  <&(0). 


2.  Circumventing  Uncertainty  by  a  Vector  Maximum  Reformulation 
In  order  to  circumvent  the  uncertainty  attending  the  objective 
function  of  (l) ,  we  elect  to  employ  one  of  the  approaches  considered 
at  some  length  in  Chapter  I:  a  vector  maximum  reformulation  using 
the  expected  value  criterion  and  the  maximum  .05-fractile  criterion 
(some  fractile  other  than  the  .05-fractile  could  be  used  if  desired). 
Assume  that  4>(p)  is  continuous,  strictly  increasing  on  the  entire 
real  line,  and  that  its  mean  is  zero  (if  the  mean  is  not  zero,  it 
can  be  incorporated  into  the  a^) .  One  derives  that  the  mean  and 
.05-fractile  of  the  objective  function  for  fixed  x  are,  respectively, 

n 

f^x)  =  2  (ai  -  -  ci)xi  +  (di/ki)in(kixi  +  l) 

if  £  b^  >  0 

if  £  ^x  <  0  . 

In  place  of  (l)  we  consider  the  vector  maximum  problem 


(2) 


"Maximize"  f^(x),  f2(x) 

x 

subject  to  g(x)  >  0  . 


The  efficient  outcomes  of  (2)  are  to  be  computed  and  plotted  (as  in 
Figure  5  below)  so  as  to  present  a  "tradeoff  curve"  between  the  two 
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criteria.  A  decision-maker  then  subjectively  determines  a  point  on 
the  tradeoff  curve,  and  implements  the  corresponding  optimal  production 
schedule . 

3*  An  Equivalent  Parametric  Programming  Reformulation 

p 

The  hessian  of  f^(x)  is  a  diagonal  matrix,  with  -k^/CkjX^+l) 
on  the  diagonal.  When  x  >  0,  the  assumed  positivity  of  and 
d^  implies  that  this  hessian  is  negative  definite.  By  A.  3,  therefore, 
f^(x)  is  seen  to  be  strictly  concave  on  the  non-negative  orthant. 

An  enumeration  of  cases  shows  that  f^(x)  is  also  strictly  concave 
on  the  non- negative  orthant  when  4>-1(.05)  <  0  and  ®’1(-95)  >  0. 

In  view  of  our  assumption  that  the  mean  is  0,  it  is  reasonable  to 
assume  that  this  last  condition  holds.  Assuming  further  that  each 
constraint  function  is  concave,  we  conclude  that  Proposition  6  of 
Chapter  II  appl„cs.-^  Hence  to  find  all  efficient  solutions  of  (2) 
it  is  equivalent  to  find  the  optimal  solutions  of 

Maximize  (l-oOf^x)  +  af2(x) 

(3)  2 

subject  to  jg(x)  >  0 

for  each  value  of  a  in  the  unit  interval. 

Consider  (3)  with  a  fixed.  The  presence  of  the  logical  con¬ 
dition  in  the  definition  of  f2  makes  the  solution  of  (3)  somewhat 

It  is  easy  to  see  that  Proposition  6  still  holds  if  the  f^  are 
assumed  to  be  strictly  concave  on  X,  and  not  necessarily  on  En. 


Ill 


awkward.  One  approach  is  to  solve  the  pair  of  problems 

Maximize  (l-ajf^x)  +a[f1(x)  +  ®“1(.05)  £  b^] 

(4)  subject  to  g(x)  >  0 

D  Vi  - 0 

Maximize  (l-cOf^x)  +  o[ f  (x)  +$“1(.95)  £  VJ 

(5)  subject  to  £(x)  >  0 

S  bixi  5  0  * 

The  optimal  value  of  (3)  equals  the  larger  of  the  optimal  values 
of  (4)  and  (5),  since  the  feasible  regions  of  (4)  and  (5)  are  merely 
a  dichotomy  of  that  of  (3).  We  shall  avoid  this  complication,  however, 
by  requiring  of  our  numerical  example  that  b^  >  0  (i  *  l,...,n)j 
since  x  >  0,  this  condition  implies  that  £  b^x^  >  0,  and  therefore 
(3)  may  be  rewritten  as 

Maximize  (l-oOf^x)  +  a[  f^x)  +  $-1(.05)  ^b.^] 

(6)  x 

subject  to  jg(x)  >  ^0  . 

4.  Solving  the  Parametric  Problem 

We  shall  solve  a  numerical  example  based  on  (6)  with  n  =  4 
and  m  =  7-  Table  1  gives  the  numerical  data  for  the  objective 
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function,  and  the  constraints-'  are: 


>  0,  i  =  1,  ...»  4 


- . Olx^  - . 01x2 

-.04x^ 

-.04x^  +  2  >  0 

-.4  x1  -.4  Xg 

-.lx, 

3 

-.1  x^  +  20  >  0 

2  2 
-.Olx*  - . OlXg 

-.01x| 

-.OlxJ  +  15  >  0  . 

i  =  1 

i  =  2 

i  =  3 

i  =  4 

ai 

10.0 

12.0 

10.5 

11.0 

bi 

0.0634 

0.0930 

0.6740 

0.7540 

Ci 

8.0 

10.0 

8.5 

9-0 

4i 

2.50 

2.55 

2.20 

2.25 

ki 

0.12 

0.13 

0.045 

0.050 

Table  1-^ 


It  is  further  assumed  that  P  is  normally  distributed  with  zero 
mean  and  unit  variance.  Hence  #’1(.05)  =  -1.64. 

It  is  clear,  since  k^,b^  >0  (i  =  1,...,4),  that  f^,  f^ 
and  g.^  (i  =  1,...,7)  are  analytic  on  some  open  region  containing  the 
non- negative  orthant.  Because  the  constraints  are  concave,  therefore, 


Each  represents  hundreds  of  units  of  product  i.  The  last 

three  constraints  are  to  be  interpreted  as  constraints  on  three 
resources,  which  we  refer  to  as  resources  A,  B,  and  C  respectively. 
Resources  are  measured  in  thousands  of  units. 

— /  The  units  of  the  coefficients  are  such  that  f^  and  fg  are  in 
thousands  of  dollars. 
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Condition  1  of  Chapter  III  is  satisfied.  Since  resources  are  limited 
in  all  real  problems  of  this  type,  Condition  2  is  not  restrictive, 
and  in  fact  holds  for  the  feasible  region  of  our  numerical  example. 

It  was  observed  above  that  the  hessian  of  f^  is  negative  definite 
on  the  non- negative  orthant,  and  the  same  is  true  for  fg,  so  that 
Condition  3  holds.  We  shall  not  bother  to  verify  whether  Condition  4 
is  satisfied  by  our  numerical  example. 

A  version  of  the  Basic  Computational  Algorithm  for  solving  (6) 
was  coded  for  the  Burroughs  B5000  computer.  No  attempt  was  made  to 
optimize  program  efficiency  beyond  the  incorporation  of  a  simple 
variable  step  size  feature  (see  the  last  two  paragraphs  of  section  3 , 
Chapter  III) .  The  results  of  the  computation  are  presented  in 
Figures  1,  2,  and  3-  Figure  1  is  a  graph  of  the  optimal  production 
schedule,  x*(a),  as  a  function  of  a.  Note  the  markers  at  the 
following  values  for  a,  each  of  which  is  a  point  of  change  marking 
an  execution  of  Step  3:  0.6024,  0-7819;  0.8338.  Since  no  false  or 

silent  alarms  are  encountered  at  any  of  these  points.  Step  3  is 
executed  in  each  case  with  no  erroneous  trials.  Figure  2  presents 
graphs  of  u*(ct)  and  gi(x*(a))  (i  =  5,6,7).  Note  that  the  dual 
variables  (or  "shadow  prices")  u*(a)  (i  =  1,...,4)  are  not  graphed, 
since  they  are  identically  zero  on  [0,1],  and  that  it  is  not  necessary 
to  graph  the  non- negativity  constraints.  Figure  3  is  a  plot  of  the 
efficient  outcomes  associated  with  the  two  criterion  functions— a 
tradeoff  curve.  It  shows,  for  example,  that  production  plan  X*(0.807) 
guarantees  a  profit  of  at  least  $32,700  with  probability  .95  and  an 
expected  profit  of  $79,100. 
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SURPLUS  RESOURCES  g(x*(a) )  SHADOW  PRICES  u*(at) 

(THOUSANDS  OF  UNITS)  (DOLLARS  PER  UNIT  OF  RESOURCE) 


EXPECTED  PROFIT 
(IN  THOUSANDS  OF  DOL 


APPENDIX  A 


Some  Properties  of  Convex  Sets  and  Concave  Functions 

A  set  S  in  En  is  said  to  be  convex  if  (\x' +(l-\)x")  €  S 
whenever  x',x"  e  S  and  0  <  \  <  1. 

A  function  f(x)  which  is  defined  on  a  convex  set  S  is  said 
to  be  concave  if  f(\x'+(l-\)x")  >  \f(x' )+(l-\)f(x")  whenever 
x',x"  €  S  and  0  <  \  <  1.  If  the  first  inequality  holds  strictly 
whenever  x'  ^  x"  and  0  <  \  <  1,  f(x)  is  said  to  be  strictly 
concave.  The  function  -f(x)  is  said  to  be  convex  or  strictly 
convex  according  as  f(x)  is  concave  or  strictly  concave.  When  the 
convex  set  S  is  not  specified  explicitly,  it  is  implicitly  taken 
to  be  the  entire  space. 

The  following  properties  of  convex  sets  and  concave  functions 
are  used  in  the  text.  The  proofs,  most  of  which  follow  easily  from 
the  definitions,  may  be  found  in  Fenchel  (1955)  or  Zoutendijk  (i960). 

A.l  If  g^x)  (i  =  l,...,ra)  are  concave  functions  on  En, 

then  (x:  g^x)  >0,  i  =  l,...,m)  is  a  closed  and  convex 

set. 

A. 2  Any  local  maximum  of  a  concave  function  on  a  convex  set  is 
also  a  global  maximum  over  that  set;  a  strictly  concave 
function  can  have  at  most  one  local  maximum. 

A.  5  A  twice- differentiable  function  defined  on  a  convex  set  S 
is  concave  if  and  only  if  its  hessian  matrix  is  negative 
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semidefinite  at  each  x  e  S.  If  the  hessian  is  negative 
definite  at  each  x  e  S,  then  the  function  is  strictly 
concave  (the  converse  is  not  true  in  general,  but  does 
hold  when  the  function  is  a  quadratic  polynomial  and  S  =  En) . 


A.k 


If  f^(x)  (i  ■  are  concave  functions  on  a  convex 

set  S,  and  u,  >  0  (i  ■  l,...,k),  at  least  one  u.  >  0, 
k  1  “  1 

then  ^  u^f^(x)  is  concave  on  Sj  if  f‘i (x)  is  strictly 

concave  for  some  i  such  that  u.  >0,  then  £  u.  f .  (x) 

l  !  1  1  " 


is  strictly  concave. 


A.  5  A  concave  or  convex  function  on  a  convex  set  S  is  con¬ 
tinuous  at  every  relative  interior  point  of  S. 

A. 6  If  f(x)  is  differentiable  and  concave  on  a  convex  set  S 
and  Vxf(x°)  =  0,  x°  e  S,  then  f(x°)  >  f(x)  for  all 
x  e  S. 

A.  7  The  Theorem  of  the  Separating  Hyperplane  asserts  that  if 
S  and  T  are  two  convex  sets  in  En  with  no  interior 
point  in  common,  then  there  exist  an  n-vector  v  ^  0  and 
a  scalar  c  such  that  7\  v.s.  <  c  <  V  v. t.  for  all 

u  ii-  -£✓  ii 

s  e  S,  t  e  T  (see  Karlin,  1959>  P-  398  Tor  a  proof). 
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APPENDIX  B 


Graphical  Examples 


We  shall  illustrate  the  Basic  Conceptual  Algorithm  by  considering 
three  examples  of  the  form 


(B.l) 


Maximize 

x 


<*£  -(xi  -Cp2  +  (1-a)  p  .(xi  - 


2 


subject  to 


a^x  +  b^.  >  0, 


i  -  1, 


m  . 


The  first  example  in  well-behaved  in  the  sense  that  there  are  no 
false  or  silent  alarms  (see  section  4.1  for  definitions  of  "false" 
and  "silent"  alarms),  whereas  in  the  second  and  third  examples  such 
troubles  do  occur. 

Problems  of  the  form  (B.l)  are  among  the  simplest  which  can  be 
subsumed  under  the  present  theory:  both  objective  functions  are 
quadratic  and  linearly  separable,  and  the  constraints  are  linear. 

The  fact  that  false  and  silent  alarms  can  occur  for  such  problems 
seems  to  render  unlikely  the  existence  of  a  special  class  of  (Ba) 
for  which  false  and  silent  alarms  cannot  occur. 

The  examples  to  be  given  are  presented  and  analyzed  graphically 
rather  than  numerically  because  (B.l)  is  readily  amenable  to  graphical 
interpretation  when  n  =  2  (the  case  considered  here).  Let  <X  be 
fixed.  When  S  is  a  consistent  set,  i.e.,  when  Xg  =  {x:  a^x^  + 
b^  =  0,  V  i  e  S)  ^  0,  it  follows  from  the  Kuhn- Tucker  Theorem  that 
(=S)a  is  necessary  and  sufficient  for  a  maximum  of  the  objective 
function  subject  to  x  €  X,_.  From  the  circularity  of  the  level 

—  O 
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curves  of  this  particular  objective  function  it  is  evident  that  this 
constrained  maximum  is  just  the  point  of  X  nearest  to  the  uncon- 
strained  maximum  ‘x(a)  =  ac'  +  (l-a)c. 

Each  figure  is  drawn  in  x- space  (n  =  2)  with  two  constraints 
(m  *  2).  The  loci  of  g^OO  =  0,  g2(x)  =  0,  the  unconstrained 
maximum  x(a),  and  the  constrained  maximum  x*(a)  (the  heavy  line) 
are  drawn,  as  well  as  certain  features  pertaining  to  the  points  of 
change.  Light  lines  representing  the  projection  of  x(a)  onto  the 
feasible  region  are  also  drawn;  in  view  of  the  circularity  of  the 
level  curves  of  the  objective  function  for  fixed  a,  these  lines  are 
in  the  direction  of  the  gradient  of  the  objective  function  at  x*(a) . 
The  gradients  of  the  constraints  point  into  the  feasible  region. 

From  (=S)a  we  see  that  the  dual  variables  express  minus  the 

g 

gradient  of  the  objective  function  at  x  (a)  as  a  linear  combination 

r« 

of  the  gradients  of  the  constraints  in  S.  The  signs  of  u?(a) 

(i  €  S)  are  easily  determined  by  visual  inspection  of  the  figures. 

The  first  example  is  presented  graphically  in  Figure  B. 1.  At 
a  =  0  the  unconstrained  maximum  $(0)  is  interior  to  the  feasible 
region.  Thus  the  constrained  maximum  x*(o)  equals  x(0)  and 
Bo  =  0,  which  implies  that  Ao  =  0  since  A2CLB3  for  all  a. 

We  are  obliged  to  let  S°  =  0,  for  the  empty  set  is  the  only  valid 
set  at  a  =  0  (recall  that  S  is  valid  at  a  if  and  only  if 
AaCSCBa).  Step  1  is  complete.  Step  2  demands  that  we  solve 
(=0)a  as  OL  increases  above  0  until  an  alarm  is  given,  i.e., 
until  x^(a)  leaves  the  feasible  region  or  u^(a)  becomes  negative 
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for  some  i.  The  last  alternative  (an  optimality  alarm)  cannot  happen 
for  S°  =  0,  for  (=0)a  requires  u^(a)  =  0.  Only  the  first  alternative 
(a  feasibility  alarm)  can  occur.  Equations  (=0)a  are  easily  seen 
to  be  the  conditions  for  an  unconstrained  maximum.  Since  x(0)  is 
interior  to  the  feasible  region  for  0  <  a  <  a^,  no  alarms  are  given 
on  [0,0^);  (x^(a) ,  u^(a))  *  (x*(a),  u#(a))  ■  (£(at),o)  and  Pa  -  Ba  »  0 
on  [0,cO.  At  the  unconstrained  maximum  happens  to  be  on  the 

boundary  of  the  feasible  region,  but  beyond  it  violates  the  first 

constraint,  i.e.  (*0)a  leads  to  a  feasibility  alarm  for  g1  Just 

above  c^.  Thus  is  the  point  of  change  which  completes  Step  2, 

and  (x^G^),  ufyci^))  «  (x*^),  u*^))  ■  (x^^O),  Pa1  -  0, 

BO^  =  (l).  Since  <  1,  we  go  to  Step  J*  Two  sets  are  valid  at 
01:  0  and  (1).  The  former  was  seen  at  Step  2  not  to  be  valid 

above  a^,  and  so  the  latter  must  be.  Control  is  now  returned  to 
Step  2  with  S°  =  (l). 

To  execute  Step  2  for  the  second  time  we  must  solve  (;={l})a  as  a 
increases  above  <x^  until  an  alarm  obtains.  These  equations  are  the 
conditions  for  a  maximum  of  the  objective  function  subject  to  the 
first  constraint  being  exactly  satisfied.  As  a  increases  above 
a1,  x^(a)  moves  along  the  portion  of  the  boundary  determined  by 

the  first  constraint;  since  minus  the  gradient  of  the  objective 
function  at  x^a)  is  expressed  as  u^(a)  times  the  gradient  of 
g^,  it  is  geometrically  clear  that  u^(a)  grows  increasingly  positive 
as  a  increases.  Hence  no  alarms  are  given  until  a ^  is  passed, 
when  the  second  constraint  begins  to  be  violated.  We  have 
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x1(a)  =  x*(a),  u|(a)  =  u*(a)  >  o,  u \(a)  --  u*(d)  o,  Pa  =  Ba  =  {1} 

on  .  Since  <  1  is  the  point  of  change  at  which  Step  2 

is  completed,  we  go  to  Step  3*  Now  A3 2  =  {1}  and  B3 2  =  {1,2},  so 

that  {1}  and  {1,2}  are  valid  at  since  the  former  was  seen 

not  to  be  valid  Just  above  a^,  the  latter  must  be.  Control  is 

returned  to  Step  2  again,  this  time  with  S°  =  {1,2}. 

Step  2  now  requires  that  (={l,2))<3  be  solved  as  (3  increases 

above  until  an  alarm  occurs.  These  equations  are  the  conditions 

for  a  maximum  of  the  objective  function  subject  to  both  constraints 

being  satisfied  exactly.  Since  the  intersection  of  the  two  equality 

1  2 

constraints  determines  a  unique  point,  x  *  (a)  is  constant  for  all 

a.  The  projection  lines  of  x(a)  onto  the  feasible  region  and  the 

interpretation  of  the  dual  variables  make  it  clear  that  u  '  (a)  >  0 

on  (a2,a5),  uj,2(a^)  =  0,  u2,2(a^)  >  0,  and  u^,2(a)  <  0, 

1  2 

u^’  (a)  >  0  for  a  >  Cty  In  other  words,  an  optimality  alarm  occurs 

for  the  first  constraint  just  above  a y  so  that  Step  2  is  complete 

at  that  point  of  change.  Going  to  Step  3>  we  see  that  A3^  =  {2}, 

B3*  =  {1,2};  since  the  latter  is  not  valid  just  above  aT  the  former 
3  3 

must  be.  Control  is  returned  to  Step  2  with  S°  =  {2}. 

At  Step  2,  (={2})a  must  be  solved  as  a  increases  above  OLy 

Reasoning  as  before,  we  see  that  {2}  remains  valid  on  [<3yl]. 

Hence  x2(d)  =  x*(a) ,  Pa  =  B3  =  {2},  u2(a)  =  0,  and  u2(d)  >  0 
on  (oyl]. 

This  completes  the  solution  of  the  first  example.  A  summary 
appears  in  Table  B. 1.  Note  that  there  were  no  false  or  silent  alarms, 
and  no  erroneous  trials  at  any  Step  3« 
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The  second  and  third  examples  are  presented  graphically  in 
Figures  B.2  and  B.3*  The  summaries  which  appear  in  the  corresponding 
Tables  B.2  and  B. 3  can  be  constructed  by  following  the  lines  of 
reasoning  illustrated  in  the  above  discussion  of  the  first  example. 
Nevertheless,  certain  of  the  entries  are  reasoned  out  below.  The 
second  example  is  designed  to  show  that  false  feasibility  and  silent 
optimality  alarms  can  occur,  the  third  to  show  that  false  optimality 
and  silent  feasibility  alarms  can  occur. 

The  second  example  is  very  much  like  the  first,  except  that  the 
unconstrained  maximum  happens  to  pass  through  the  vertex  of  the  feasible 
region.  At  a  =  a^:  x*^)  =  x^) ,  AO^  =  0,  and  =  {1,2}. 

At  Step  3  one  must  solve  (=S)a  for  a  just  above  a.,  S  valid  at 
a^,  until  a  set  which  is  valid  just  above  is  found.  Hie  four 
sets  0,  (l),  {2},  and  {1,2}  are  valid  at  G^.  If  one  tries  0, 
it  is  clear  that  x^(a)  =  x(a)  violates  both  constraints  as  a 
increases  above  a^,  and  also  that  only  {2}  is  valid  just  above 
cr^.  Hence  there  is  a  false  feasibility  alarm  for  g^,  for  g^  is 
not  in  the  deficiency  of  0  and  is  not  degenerate  just  above  0^. 

See  the  second  line  of  Table  B.2.  If  one  tries  {l},  (={l})Q£  are 

the  conditions  for  a  maximum  of  the  objective  function  subject  to  the 
first  constraint  being  exactly  satisfied.  It  is  evident  that  x^(a) 
violates  the  second  constraint  above  a^,  i.e.  a  feasibility 
alarm  for  g^  obtains.  Since  minus  the  gradient  of  the  objective 
function  at  x^C**)  is  expressed  as  u^(a)  times  the  gradient  of 
g^,  u1(a)  is  seen  to  be  positive  above  a^.  Thus  no  optimality 
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alarm  obtains  for  ,  whicn  means,  in  view  of  the  unique  validity 
of  {2}  above  and  the  fact  that  g^  is  in  the  excess  of  {1} 

just  above  a^,  that  (={l})a  leads  to  a  silent  optimality  alarm. 

See  the  third  line  of  Table  B.2. 

In  the  third  and  last  example,  the  unconstrained  maximum  again 
happens  to  pass  through  the  vertex  of  the  feasible  region.  At  a  =  a^, 
we  have  x*^)  =  xfc^),  PCt^  =  0,  and  BQ^  =  {1,2}.  The  valid  sets 
at  Qf^  are  0,  (l),  {2},  and  {1,2}.  The  only  set  which  is  valid 

Just  above  is  {2}.  If  one  tries  {1}  at  Step  3,  x^(a) 

evidently  remains  feasible.  Since  g2  is  in  the  deficiency  of  {1} 
just  above  a  ,  we  see  that  (={l})a  leads  to  a  silent  feasibility 
alarm,  as  recorded  in  the  third  line  of  Table  3.3*  If  one  tries 
{1,2},  x  ’  (a)  must  remain  at  the  intersection  of  the  two  equality 
constraints.  It  is  graphically  clear  that  minus  the  gradient  of  the 
objective  function  at  x  *  (a)  =  x*(ai)  is  represented  by  a  negative 
linear  combination  of  the  gradients  of  the  constraints  as  a  increases 
above  a^,  so  that  optimality  alarms  occur  for  both  constraints. 

Since  is  not  in  the  excess  of  {1,2}  and  is  not  degenerate  just 

above  0^,  a  false  optimality  alarm  registers  for  the  second  con¬ 
straint.  See  the  fifth  line  of  Table  B.  3- 
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False  feasibility  alarm  for 

2  / 

Silent  optimality  alarm:  no  optimality  alarm  for  u^. 
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APPENDIX  C 


Computational  Devices 


1.  Newton's  Method 

Newton's  method  is  based  on  using  successive  linear  approximations 
for  solving  systems  of  nonlinear  equations  when  good  first  approxi¬ 
mations  of  the  solutions  are  available.  In  order  to  solve  the  system 


(C.l) 


fx(x)  =  0 
f2(x)  =  0 

f  (x)  =  0  , 
n  - 


where  x  is  an  n-vector,  Newton's  method  is  the  recursion 

r  v  n  -1 

f(xk),  k  «  0,  1,  2,  ... 

where  x°  is  a  given  starting  point.  The  stated  inverse  must 
exist  in  order  for  (C.2)  to  be  well-defined,  of  course.  We  denote 
the  right-hand  side  of  (C.2)  by  F(xk).  F(x)  is  the  iteration 
function  obtained  by  applying  Newton's  method  to  (C.l). 

There  are  numerous  versions  of  conditions  under  which  Newton's 
method  can  be  guaranteed  to  converge.  The  following  theorem  is 
typical. 


(C.2) 


k+1 


k 

x  - 


ofi(x  ) 
33T 


Theorem  C.l  I 

Assume  that  f^(x)  (i  =  l>..**n)  is  continuously  differentiable 
on  some  neighborhood  of  x*,  and  that  the  Jacobian  1  does  not 


vanish  at  x*,  where  f(x*)  =  0.  Then  Newton's  method  is  well-defined 
and  quadratically  convergent  to  x*  if  the  starting  point  x°  is 
in  a  sufficiently  small  neighborhood  of  x*. 

See  Householder  (1955,  p.  136)  for  a  proof. 

Quadratic  c<  nvergence  of  the  sequence  <  x  >  (k  =  0,1,....) 
to  x*  means  that  (here  11*11  denotes  the  Euclidean  norm) 

llxk  -  x*|| 

lira  — =-? — — - -  =  a  constant  ^  0  . 

k  -  -  Iix"-1 .  x*r 

By  way  of  contrast,  linear  convergence  would  mean  that 

!ixk  -  x*|| 

lim  — =-Tj -  =  a  constant  f  0  . 

k  -  -  llx*'1  -  x*|| 

Evidently  the  quadratic  convergence  of  Newton's  method  is  a  highly 
desirable  feature.  The  price  one  pays  for  it  is  the  necessity  of 
evaluating  an  inverse  matrix  at  each  iteration,  and  having  to  have 
a  good  starting  point.  ‘To  ameliorate  the  first  disadvantage,  at  some 
expense  of  speed  of  convergence,  approximate  inverses  can  be  used. 

Often  one  can  achieve  a  substantial  net  gain  in  computational  efficiency 
by  judicious  application  of  this  idea  (see,  for  example,  Ostrowski, 
i960,  and  Householder,  1953,  P*  136). 

For  the  purpose  of  proving  Theorems4.1  and  4.2,  we  find  it  more 
convenient  to  employ 
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7 


h 


Theorem  C.2  ; 

Let  x*  satisfy  f(x*)  =  0.  Assume  that  there  exists  a  neigh¬ 
borhood  Nr(x*)  on  which  the  following  three  assertions  hold: 

(a)  The  functions  f^(x)  (i  =  l,...,n)  are  twice  con¬ 
tinuously  differentiable. 


(b)  The  Jacobian  d(f (x) )  ^  q. 

d(x) 


Then  Newton's  method  (C.2)  is  well-defined  ana  quadratically 
convergent  to  x*  if  the  starting  point  x°  is  in  Nr(x*). 

This  theorem  follows  from  results  given  in  Householder  (1953> 
p.  135)  and  Henrici  (1964,  p.  101) . 

Remark:  The  square-root  expression  in  (c)  is  an  upper  estimate  of 
the  Euclidean  norm  of  the  Jacobian  matrix  of  F(x)  (see 
Faddeeva,  1959>  P-  121) . 


For  reference  we  record  the  recursion  equation  of  Newton's  method 
applied  to  (=S)aQ.  We  have,  for  k  =  0,1,2,... 


/if1 . 

‘H  :  Dt_ 

'^Vx (r(x;a)  +  S  ui  ^ 

U) 

d  ;  0 

t 

\  Ss(i>  j 

where  H  =  Vx(f(*>a)  +  2/  ui  S^(x))>  D  is  matrix  whose  rows 

s 

are  ^g^x)  (i  e  S),  and  u^  and  are  the  vectors  obtained 
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by  deleting  from  u  and  ^(x)  the  components  not  in  S;  all  quan- 

k 

titles  on  the  right-hand  side  are  evaluated  at  a  and  (x,u  )  . 

0  *  — b 

Note  that  the  equations  u^  =  0  (i  ft  S),  which  are  a  part  of 
(=S)aQ,  have  been  omitted  from  the  recursion  because  they  are  already 
solved. 

In  order  to  have  a  compact  notation  for  the  square-root  expression 
in  (c)  of  Theorem  C.2  specialized  to  (=S)aQ>  we  denote  by  A(x,u:  ao,S) 
the  square-root  of  the  sum  of  the  squares  of  all  the  elements  of  the 
Jacobian  matrix  of  the  iteration  function  appearing  ir  (C.J)  (i.e.,  of 
the  Jacobian  matrix  of  the  right-hand  side  of  (C.3)  considered  as 
a  vector- valued  function  of  (x,Ug)). 


2.  Convenient  Partitions  of  the  Inverse  Matrix  Required  by  Newton's 
Method 


Let 


-1 


H  |  D 

D  !  0 
I 


be  defined  as  in  ( C . 3) ♦  Under  our  conditions,  it  is  easily  verified 
that 


H  i  D1 

1 

-± 

H"1  -  H‘1Dt(DH-1Dt)'1DH"1 

H"1Dt(DH”1Dtr1" 

D  ;  0 

(DH_1Dt)“1DH_1 

-(DH-V)-1  _ 

(C.4) 


Let  there  be  s  elements  in  S  (by  Condition  4,  s  <  n) .  The 
inversion  of  the  n+s  by  n+s  matrix  has  been  reduced  to  the  inversion 
of  two  matrices,  one  n  by  n  (H)  and  the  other  s  by  s  (DH”^D^), 
and  to  several  matrix  multiplications. 
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Whereas  the  size  of  H  remains  constant  no  matter  what  S  is, 
the  dimension  of  DH_1D^  does  vary  with  S,  for  during  Step  3  rows 
are  added  to  and  deleted  from  D  as  S  changes.  It  is  advantageous 
to  use  bordering  methods  to  pass  from  an  available  (DH'^D^)*1  to 
the  next  when  S  is  changed  at  Step  3*  We  shall  consider  the  case 
in  which  one  row  is  added  to  "the  bottom"  of  D,  and  also  the  case 
in  which  the  last  row  of  D  is  deleted.  Results  similar  to  the 
following  can  be  derived  to  cover  the  addition  or  deletion  of  an 
arbitrary  row,  and  also  multiple  additions  and/or  deletions. 

If  one  row  d  is  to  be  added  to  D,  then 

,-l 


f 

r  m 

,-1 

r  -it 

!  -l  1 1 

D 

H'1[Dt  ‘  dfc] 

. 

DH  D  ;  DH  d 
-It!  -It 

< 

d 

m  m 

L™  D 

;  dH  d  J 

(DH‘1Dt)"1  + 

Qd  dQ 
dRd1 

QdL 

dRd1 

dQl 

dRd1 

l/ dRdt 

where  Q  =  -(DH"1Dt)”1DH-1  and  R  =  H_1  -  H"1Dt(DH"1Dt)'1DH‘1. 
Note  that  Q  and  R  are  immediately  available  from  (C.4) 

Let  D  be  written 


and  let  be  written 


T1  !  V 

t 


'  T 

2  »  a3' 
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where  Tz  i a  .L  by  '!  (i.c.,  in  a  scalar).  IT  row  d  .s  deleted 

from  U,  then  (D  T..  -  T.,  tJVt,. 

3.  A  Refinement  Method  for  Approximate  Matrix  Inverses 

Suppose  that  A  is  a  square  matrix  whose  inverse  exists  and  is 

desired  to  be  found,  and  that  an  approximate  inverse  Bq  is  available. 

The  error  inherent  in  B  causes  the  matrix  I-AB  not  to  vanish. 

o  o 

If—/  || I-AB  ||  <  L  <  1,  then  the  recursion 

o  — 

B^  =  +  B^^(l  -  ABj^) ,  k  =  1,  2,  ... 

converges  to  A-1,  and  the  considerable  rapidity  of  the  convergence 
is  apparent  from  the  estimate 

||br  -  a'1!!  <  IIbJI  l2k/(i-l)  . 

See  Faddeeva  (1959>  PP*  99-102)  for  further  details  on  this 
method,  which  is  due  to  H.  Hotelling. 

It  is  clear  that  this  device  can  be  used  to  great  advantage 
in  maintaining  an  arbitrarily  accurate  approximation  to  H_1  as  a 
increases  (for  the  elements  of  H,  and  therefore  of  H~\  are  con¬ 
tinuous  functions  of  a  on  the  unit  interval),  and  also  to 
(DH  ^D^)"1  so  long  as  S  stays  the  same. 

-/  We  define  the  norm  ||a||  of  any  n  by  n  matrix  A  as 
n 

Max  2)  la-J*  Other  norms  could  be  used,  but  this  one  (the 
1  <  j  <  n  1=]. 

so-called  "p  =  1  norm")  is  particularly  convenient  for  computational 


purposes. 


Whereas  the  size  of  H  remains  constant  no  matter  what  S  is, 
the  dimension  of  does  vary  with  S,  for  during  Step  3  rows 

are  added  to  and  deleted  from  D  as  S  changes.  It  is  advantageous 
to  use  bordering  methods  to  pass  from  an  available  (DH'^D^)”1  to 
the  next  when  S  is  changed  at  Step  3*  We  shall  consider  the  case 
in  which  one  row  is  added  to  "the  bottom"  of  D,  and  also  the  case 
in  which  the  last  row  of  D  is  deleted.  Results  similar  to  the 
following  can  be  derived  to  cover  the  addition  or  deletion  of  an 
arbitrary  row,  and  also  multiple  additions  and/or  deletions. 

If  one  row  d  is  to  be  added  to  D,  then 


D 

d 


H"1[Dt  id*] 


1 

DK“1Dt 

!  DH"1dt 

-L-. 

.  -^t 

;  dH  d  J 

-1 


(DH'Vr1  + 

QdXdQ 

dRd* 

Qd 

dRd* 

dQ* 

dRd* 

l/dRd* 

where  Q  =  -(DH'1Dt)"1DH’1  and  R  =  H’1  -  H"1Dt(DH"1Dt)"1DH-1. 
Note  that  Q  and  P.  are  immediately  available  from  (C.U) 

Let  D  be  written 


ld 

and  let  (DH_1D*)_1  be  written 
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where  T7  in  1  by  1  (i.e.,  in  a  scalar).  IT  row  d  is  deleted 

from  D,  then  T,  -  T‘  tVt,. 

l  i.  ±  it  d  j 

3.  A  Refinement  Method  for  Approximate  Matrix  Inverses 

Suppose  that  A  is  a  square  matrix  whose  inverse  exists  and  is 

desired  to  be  found,  and  that  an  approximate  inverse  Bq  is  available. 

The  error  inherent  in  B  causes  the  matrix  I-AB  not  to  vanish. 

o  o 

If—/  ||  I-AB  II  <  L  <  1,  then  the  recursion 

o  — 

Bk  =  Bk-1  +  Bk-1^  "  ABk-l^  k  =  1,  2,  ... 

converges  to  A-"*",  and  the  considerable  rapidity  of  the  convergence 
is  apparent  from  the  estimate 

II Bk  -  A-1||  <  ||B0I|  L2k/(1-L)  . 

See  Faddeeva  (1959>  PP-  99-102)  for  further  details  on  this 
method,  which  is  due  to  H.  Hotelling. 

It  is  clear  that  this  device  can  be  used  to  great  advantage 
in  maintaining  an  arbitrarily  accurate  approximation  to  H_1  as  a 
increases  (for  the  elements  of  H,  and  therefore  of  H-1,  are  con¬ 
tinuous  functions  of  a  on  the  unit  interval),  and  also  to 
(DH”1^)"1  so  long  as  S  stays  the  same. 


IF 


— '  We  define  the  norm 
n 


of  any  n  by  n  matrix  A  as 


Max 

£ 

1  <  j  <  n 

i=l 

so-called 

MP  = 

purposes. 

13^ 


s  s 

4.  Formulae  for  d(x  (a),  u  (a) ) /da 

It  may  be  shown  by  implicitly  differentiating  (  =  3)a  that  the 
following  additional  conclusions  can  be  added  to  Theorem  2:  for 

a  c  lao, 

d{xs(a))/d a  -  - 

d(ug(a))/da  »  Q(y,f:(x)  -y/?(x))  > 
where  R  and  Q  are  as  in  section  2  above  and  all  quantities  are 

C 

evaluated  at  (x°(a),  Ug(a)). 

These  formulae  are  of  possible  interest  for  the  purpose  of 
facilitating  the  convergence  of  Newton's  method,  when  fairly  large 
step  sizes  are  being  used,  by  extrapolating  to  better  starting  points. 
Note  that  R  and  Q  are  immediately  available  from  (C.4). 
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